Elamur Research⌕
☰
home / authors / Illia Polosukhin / cited by

Who cites Illia Polosukhin

18,396 citations of their works from 18,005 papers of our library (of the 140,884 whose bibliographies we read) · 1,116 with a page here, the most cited first · page 1 of 12 · 1–100 · ← Illia Polosukhin

1 2 … 12

  1. BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingJacob Devlin, Ming-Wei Chang, Kenton Lee, et al.2019 · 23,422 citations
  2. Transformers: State-of-the-Art Natural Language ProcessingThomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,591 citations
  3. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,752 citations
  4. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 10,782 citations
  5. Graph Attention NetworksPetar Veličkovic, Guillem Cucurull, Arantxa Casanova, et al.2017 · 8,996 citations
  6. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,295 citations
  7. BioBERT: a pre-trained biomedical language representation model for biomedical text miningJinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.2019 · 8,281 citations
  8. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerColin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 7,433 citations
  9. ChatGPT for Good? On Opportunities and Challenges of Large Language Models for EducationEnkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, et al.2023 · 7,429 citations
  10. Representation Learning with Contrastive Predictive CodingAaron van den Oord, Yazhe Li, Oriol Vinyals2018 · 6,826 citations
  11. Survey of Hallucination in Natural Language GenerationZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,947 citations
  12. Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, et al.2021 · 5,910 citations
  13. LLaMA: Open and Efficient Foundation Language ModelsHugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 5,609 citations
  14. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,375 citations
  15. Sentence-BERT: Sentence Embeddings using Siamese BERT-NetworksNils Reimers, Iryna Gurevych2019 · 4,838 citations
  16. A Call for Clarity in Reporting BLEU ScoresMatt Post2018 · 4,130 citations
  17. Energy and Policy Considerations for Deep Learning in NLPEmma Strubell, Ananya Ganesh, Andrew McCallum2019 · 4,049 citations
  18. fairseq: A Fast, Extensible Toolkit for Sequence ModelingMyle Ott, Sergey Edunov, Alexei Baevski, et al.2019 · 3,941 citations
  19. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,921 citations
  20. Large language models are zero-shot reasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.2022 · 3,780 citations
  21. XLNet: Generalized Autoregressive Pretraining for Language UnderstandingZhilin Yang, Zihang Dai, Yiming Yang, et al.2019 · 3,740 citations
  22. Training Verifiers to Solve Math Word ProblemsKarl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.2021 · 3,675 citations
  23. A Survey on Evaluation of Large Language ModelsYupeng Chang, Xu Wang, Jindong Wang, et al.2023 · 3,640 citations
  24. SciBERT: A Pretrained Language Model for Scientific TextIz Beltagy, Kyle Lo, Arman Cohan2019 · 3,548 citations
  25. Conformer: Convolution-augmented Transformer for Speech RecognitionAnmol Gulati, James Qin, Chung-Cheng Chiu, et al.2020 · 3,433 citations
  26. On the Opportunities and Risks of Foundation ModelsRishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,044 citations
  27. Language Models as Knowledge Bases?Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.2019 · 2,977 citations
  28. CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesZhangyin Feng, Daya Guo, Duyu Tang, et al.2020 · 2,954 citations
  29. Gemini: A Family of Highly Capable Multimodal ModelsGemini Team, Rohan Anil, Sebastian Borgeaud, et al.2023 · 2,951 citations
  30. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
  31. Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingYu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon2020 · 2,636 citations
  32. PaLM: Scaling Language Modeling with PathwaysAakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 2,603 citations
  33. Hierarchical Text-Conditional Image Generation with CLIP LatentsAditya Ramesh, Prafulla Dhariwal, Alex Nichol, et al.2022 · 2,599 citations
  34. SpanBERT: Improving Pre-training by Representing and Predicting SpansMandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,580 citations
  35. Lost in the Middle: How Language Models Use Long ContextsNelson F. Liu, Kevin Lin, John Hewitt, et al.2023 · 2,540 citations
  36. Evaluating Large Language Models Trained on CodeMark Chen, Jerry Tworek, Heewoo Jun, et al.2021 · 2,529 citations
  37. Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, et al.2022 · 2,497 citations
  38. Sparks of Artificial General Intelligence: Early experiments with GPT-4Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, et al.2023 · 2,389 citations
  39. UNITER: UNiversal Image-TExt Representation LearningYen-Chun Chen, Linjie Li, Licheng Yu, et al.2019 · 2,344 citations
  40. Measuring Mathematical Problem Solving With the MATH DatasetDan Hendrycks, Collin Burns, Saurav Kadavath, et al.2021 · 2,318 citations
  41. Relational inductive biases, deep learning, and graph networksPeter W. Battaglia, Jessica B. Hamrick, Victor Bapst, et al.2018 · 2,285 citations
  42. Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image CaptioningPiyush Sharma, Nan Ding, Sebastian Goodman, et al.2018 · 2,278 citations
  43. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language TasksJiasen Lu, Dhruv Batra, Devi Parikh, et al.2019 · 2,217 citations
  44. Multimodal Transformer for Unaligned Multimodal Language SequencesYao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.2019 · 2,170 citations
  45. Flamingo: a Visual Language Model for Few-Shot LearningJean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,108 citations
  46. TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain Evans2022 · 2,047 citations
  47. Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, et al.2023 · 2,020 citations
  48. BERT Rediscovers the Classical NLP PipelineIan Tenney, Dipanjan Das, Ellie Pavlick2019 · 1,993 citations
  49. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.2020 · 1,947 citations
  50. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,827 citations
  51. Scaling Laws for Neural Language ModelsJared Kaplan, Sam McCandlish, Tom Henighan, et al.2020 · 1,814 citations
  52. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, et al.2019 · 1,806 citations
  53. AllenNLP: A Deep Semantic Natural Language Processing PlatformMatt Gardner, Joel Grus, Mark Neumann, et al.2018 · 1,804 citations
  54. DeBERTa: Decoding-enhanced BERT with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,800 citations
  55. Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language InferenceTimo Schick, Hinrich Schütze2021 · 1,796 citations
  56. What Does BERT Learn about the Structure of Language?Ganesh Jawahar, Benoît Sagot, Djamé Seddah2019 · 1,789 citations
  57. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTOmar Khattab, Matei Zaharia2020 · 1,776 citations
  58. Pre-trained Models for Natural Language Processing: A SurveyXipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,740 citations
  59. Longformer: The Long-Document TransformerIz Beltagy, Matthew E. Peters, Arman Cohan2020 · 1,737 citations
  60. OPT: Open Pre-trained Transformer Language ModelsSusan Zhang, Stephen Roller, Naman Goyal, et al.2022 · 1,709 citations
  61. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,695 citations
  62. Leveraging Passage Retrieval with Generative Models for Open Domain Question AnsweringGautier Izacard, Edouard Grave2021 · 1,674 citations
  63. Retrieval-Augmented Generation for Large Language Models: A SurveyYunfan Gao, Yun Xiong, Xinyu Gao, et al.2023 · 1,647 citations
  64. Qwen Technical ReportJinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,643 citations
  65. Universal Sentence EncoderDaniel Cer, Yinfei Yang, Sheng-yi Kong, et al.2018 · 1,616 citations
  66. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLinting Xue, Noah Constant, Adam Roberts, et al.2021 · 1,574 citations
  67. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,548 citations
  68. Unifying Large Language Models and Knowledge Graphs: A RoadmapShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,545 citations
  69. Universal Sentence Encoder for EnglishDaniel Cer, Yinfei Yang, Sheng-yi Kong, et al.2018 · 1,544 citations
  70. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextGemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,522 citations
  71. Efficient Transformers: A SurveyYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,513 citations
  72. Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be PrunedElena Voita, David Talbot, Fedor Moiseev, et al.2019 · 1,511 citations
  73. VisualBERT: A Simple and Performant Baseline for Vision and LanguageLiunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,510 citations
  74. Multi-Task Deep Neural Networks for Natural Language UnderstandingXiaodong Liu, Pengcheng He, Weizhu Chen, et al.2019 · 1,501 citations
  75. CLIPScore: A Reference-free Evaluation Metric for Image CaptioningJack Hessel, Ari Holtzman, Maxwell Forbes, et al.2021 · 1,498 citations
  76. Pre-Training with Whole Word Masking for Chinese BERTYiming Cui, Wanxiang Che, Ting Liu, et al.2019 · 1,485 citations
  77. Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.2021 · 1,423 citations
  78. Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.2020 · 1,412 citations
  79. LAION-5B: An open large-scale dataset for training next generation image-text modelsChristoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,400 citations
  80. Code Llama: Open Foundation Models for CodeBaptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
  81. Unified Language Model Pre-training for Natural Language Understanding and GenerationLi Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,389 citations
  82. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.2020 · 1,355 citations
  83. Parameter-efficient fine-tuning of large-scale pre-trained language modelsNing Ding, Yujia Qin, Guang You Yang, et al.2023 · 1,324 citations
  84. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,316 citations
  85. LaMDA: Language Models for Dialog ApplicationsRomal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,314 citations
  86. VideoBERT: A Joint Model for Video and Language Representation LearningChen Sun, Austin Myers, Carl Vondrick, et al.2019 · 1,305 citations
  87. BoolQ: Exploring the Surprising Difficulty of Natural Yes/No QuestionsChristopher Clark, Kenton Lee, Ming-Wei Chang, et al.2019 · 1,299 citations
  88. AraBERT: Transformer-based Model for Arabic Language UnderstandingWissam Antoun, Fady Baly, Hazem Hajj2020 · 1,297 citations
  89. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
  90. COMET: Commonsense Transformers for Automatic Knowledge Graph ConstructionAntoine Bosselut, Hannah Rashkin, Maarten Sap, et al.2019 · 1,282 citations
  91. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsSamuel Gehman, Suchin Gururangan, Maarten Sap, et al.2020 · 1,277 citations
  92. CTRL: A Conditional Transformer Language Model for Controllable GenerationNitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.2019 · 1,273 citations
  93. The Rise and Potential of Large Language Model Based Agents: A SurveyZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,262 citations
  94. CamemBERT: a Tasty French Language ModelLouis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,262 citations
  95. What Makes Good In-Context Examples for GPT-3?Jiachang Liu, Dinghan Shen, Yizhe Zhang, et al.2022 · 1,235 citations
  96. Latent Retrieval for Weakly Supervised Open Domain Question AnsweringKenton Lee, Ming-Wei Chang, Kristina Toutanova2019 · 1,234 citations
  97. Recipes for Building an Open-Domain ChatbotStephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,206 citations
  98. M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationJianlv Chen, Shitao Xiao, Peitian Zhang, et al.2024 · 1,196 citations
  99. BERTweet: A pre-trained language model for English TweetsDat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen2020 · 1,139 citations
  100. Program Synthesis with Large Language ModelsJacob Austin, Augustus Odena, Maxwell Nye, et al.2021 · 1,136 citations

1 2 … 12

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/illia-polosukhin/cited-by/