Elamur Research⌕
☰
home / authors / Illia Polosukhin / cited by / page 2

Who cites Illia Polosukhin

18,396 citations of their works from 18,005 papers of our library (of the 140,884 whose bibliographies we read) · 1,116 with a page here, the most cited first · page 2 of 12 · 101–200 · ← Illia Polosukhin

1 2 3 … 12

  1. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze2021 · 1,118 citations
  2. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhoneMarah Abdin, Jyoti Aneja, Hany Awadalla, et al.2024 · 1,113 citations
  3. Training Compute-Optimal Large Language ModelsJordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.2022 · 1,110 citations
  4. MASS: Masked Sequence to Sequence Pre-training for Language GenerationKaitao Song, Xu Tan, Tao Qin, et al.2019 · 1,109 citations
  5. RoFormer: Enhanced Transformer with Rotary Position EmbeddingJianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 1,072 citations
  6. Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking DatasetsYifan Peng, Shankai Yan, Zhiyong Lu2019 · 1,070 citations
  7. Quantifying Attention Flow in TransformersSamira Abnar, Willem Zuidema2020 · 1,049 citations
  8. MTEB: Massive Text Embedding BenchmarkNiklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,021 citations
  9. A Discourse-Aware Attention Model for Abstractive Summarization of Long DocumentsArman Cohan, Franck Dernoncourt, Doo Soon Kim, et al.2018 · 1,018 citations
  10. Linguistic Knowledge and Transferability of Contextual RepresentationsNelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,011 citations
  11. VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsWeijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,008 citations
  12. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, et al.2019 · 1,006 citations
  13. Attention is not ExplanationSarthak Jain, Byron C. Wallace2019 · 997 citations
  14. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 992 citations
  15. ERNIE 2.0: A Continual Pre-training Framework for Language UnderstandingYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 976 citations
  16. PaLM 2 Technical ReportRohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 971 citations
  17. GPQA: A Graduate-Level Google-Proof Q&A BenchmarkDavid Rein, Betty Li Hou, Asa Cooper Stickland, et al.2023 · 964 citations
  18. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 962 citations
  19. ERNIE: Enhanced Representation through Knowledge IntegrationYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 949 citations
  20. AdapterFusion: Non-Destructive Task Composition for Transfer LearningJonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé, et al.2020 · 948 citations
  21. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, et al.2020 · 944 citations
  22. ImageBind: One Embedding Space To Bind Them AllRohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, et al.2023 · 943 citations
  23. Patient Knowledge Distillation for BERT Model CompressionSiqi Sun, Yu Cheng, Zhe Gan, et al.2019 · 939 citations
  24. Bottom-Up Abstractive SummarizationSebastian Gehrmann, Yuntian Deng, Alexander Rush2018 · 939 citations
  25. Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesGheorghe Comanici, Eric Bieber, Mike Schaekermann, et al.2025 · 906 citations
  26. Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 901 citations
  27. Is Attention Interpretable?Sofia Serrano, Noah A. Smith2019 · 885 citations
  28. Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal2021 · 882 citations
  29. Do As I Can, Not As I Say: Grounding Language in Robotic AffordancesMichael Ahn, Anthony Brohan, Noah Brown, et al.2022 · 873 citations
  30. Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, et al.2023 · 865 citations
  31. ChatGPT: Jack of all trades, master of noneJan Kocon, Igor Cichecki, Oliwier Kaszyca, et al.2023 · 863 citations
  32. UNIFIEDQA: Crossing Format Boundaries with a Single QA SystemDaniel Khashabi, Sewon Min, Tushar Khot, et al.2020 · 843 citations
  33. Findings of the 2019 Conference on Machine Translation (WMT19)Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, et al.2019 · 839 citations
  34. MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferJonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 831 citations
  35. On the Sentence Embeddings from Pre-trained Language ModelsBohan Li, Hao Zhou, Junxian He, et al.2020 · 830 citations
  36. Unsupervised Dense Information Retrieval with Contrastive LearningGautier Izacard, Mathilde Caron, Lucas Hosseini, et al.2021 · 824 citations
  37. DocVQA: A Dataset for VQA on Document ImagesMinesh Mathew, Dimosthenis Karatzas, C.V. Jawahar2020 · 820 citations
  38. Scaling Neural Machine TranslationMyle Ott, Sergey Edunov, David Grangier, et al.2018 · 813 citations
  39. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 806 citations
  40. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 799 citations
  41. Achieving Human Parity on Automatic Chinese to English News TranslationHany Hassan, Anthony Aue, Chang Chen, et al.2018 · 794 citations
  42. Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, et al.2020 · 788 citations
  43. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital ReadmissionKexin Huang, Jaan Altosaar, Rajesh Ranganath2019 · 788 citations
  44. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
  45. LayoutLMv3: Pre-training for Document AI with Unified Text and Image MaskingYupan Huang, Tengchao Lv, Lei Cui, et al.2022 · 774 citations
  46. Reformer: The Efficient TransformerNikita Kitaev, Łukasz Kaiser, Anselm Levskaya2020 · 774 citations
  47. Non-Autoregressive Neural Machine TranslationJiatao Gu, James Bradbury, Caiming Xiong, et al.2017 · 765 citations
  48. ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionWonjae Kim, Bokyung Son, Ildoo Kim2021 · 762 citations
  49. Constituency Parsing with a Self-Attentive EncoderNikita Kitaev, Dan Klein2018 · 759 citations
  50. AdapterHub: A Framework for Adapting TransformersJonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.2020 · 747 citations
  51. Findings of the 2018 Conference on Machine Translation (WMT18)Ondřej Bojar, Christian Federmann, Mark Fishel, et al.2018 · 747 citations
  52. Unified Pre-training for Program Understanding and GenerationWasi Ahmad, Saikat Chakraborty, Baishakhi Ray, et al.2021 · 746 citations
  53. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 744 citations
  54. Integrating Multimodal Information in Large Pretrained TransformersWasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.2020 · 742 citations
  55. Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical ModelAlexander Fabbri, Irene Li, Tianwei She, et al.2019 · 738 citations
  56. Revealing the Dark Secrets of BERTOlga Kovaleva, Alexey Romanov, Anna Rogers, et al.2019 · 737 citations
  57. Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningHaokun Liu, Derek Tam, Mohammed Muqeeth, et al.2022 · 735 citations
  58. MLQA: Evaluating Cross-lingual Extractive Question AnsweringPatrick Lewis, Barlas Oğuz, Ruty Rinott, et al.2019 · 735 citations
  59. A Novel Cascade Binary Tagging Framework for Relational Triple ExtractionZhepei Wei, Jianlin Su, Yue Wang, et al.2020 · 732 citations
  60. Triton: An Intermediate Language and Compiler for Tiled Neural Network ComputationsPhilippe Tillet, H. T. Kung, David Cox2019 · 728 citations
  61. SGLang: Efficient Execution of Structured Language Model ProgramsLianmin Zheng, Liangsheng Yin, Zhiqiang Xie, et al.2023 · 710 citations
  62. A Multiscale Visualization of Attention in the Transformer ModelJesse Vig2019 · 708 citations
  63. Capabilities of GPT-4 on Medical Challenge ProblemsHarsha Nori, Nicholas King, Scott Mayer McKinney, et al.2023 · 700 citations
  64. Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 692 citations
  65. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, et al.2020 · 690 citations
  66. TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, et al.2020 · 690 citations
  67. Explain Yourself! Leveraging Language Models for Commonsense ReasoningNazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.2019 · 690 citations
  68. DialoGPT: Large-Scale Generative Pre-training for Conversational Response GenerationYizhe Zhang, Siqi Sun, Michel Galley, et al.2019 · 684 citations
  69. ELI5: Long Form Question AnsweringAngela Fan, Yacine Jernite, Ethan Perez, et al.2019 · 682 citations
  70. Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text RetrievalLee Xiong, Chenyan Xiong, Ye Li, et al.2020 · 681 citations
  71. Social Bias Frames: Reasoning about Social and Power Implications of LanguageMaarten Sap, Saadia Gabriel, Lianhui Qin, et al.2020 · 680 citations
  72. Large Language Models Are Human-Level Prompt EngineersYongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.2022 · 677 citations
  73. Mask-Predict: Parallel Decoding of Conditional Masked Language ModelsMarjan Ghazvininejad, Omer Levy, Yinhan Liu, et al.2019 · 671 citations
  74. Well-Read Students Learn Better: On the Importance of Pre-training Compact ModelsIulia Turc, Ming-Wei Chang, Kenton Lee, et al.2019 · 671 citations
  75. KILT: a Benchmark for Knowledge Intensive Language TasksFabio Petroni, Aleksandra Piktus, Angela Fan, et al.2020 · 663 citations
  76. Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionAkari Asai, Zeqiu Wu, Yizhong Wang, et al.2023 · 662 citations
  77. K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan, et al.2020 · 662 citations
  78. Similarity of Neural Network Representations RevisitedSimon Kornblith, Mohammad Norouzi, Honglak Lee, et al.2019 · 661 citations
  79. Efficient Content-Based Sparse Attention with Routing TransformersAurko Roy, Mohammad Saffar, Ashish Vaswani, et al.2020 · 660 citations
  80. CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataGuillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.2020 · 650 citations
  81. CodeSearchNet Challenge: Evaluating the State of Semantic Code SearchHamel Husain, Ho-Hsiang Wu, Tiferet Gazit, et al.2020 · 647 citations
  82. CoCa: Contrastive Captioners are Image-Text Foundation ModelsJiahui Yu, Zirui Wang, Vijay Vasudevan, et al.2022 · 646 citations
  83. Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code GenerationJiawei Liu, Chunqiu Steven Xia, Yuyao Wang, et al.2023 · 632 citations
  84. Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and BeyondMikel Artetxe, Holger Schwenk2018 · 627 citations
  85. BloombergGPT: A Large Language Model for FinanceShijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 608 citations
  86. Role-Play with Large Language ModelsMurray Shanahan, Kyle McDonell, Laria Reynolds2023 · 606 citations
  87. Towards a Unified View of Parameter-Efficient Transfer LearningJunxian He, Chunting Zhou, Xuezhe Ma, et al.2021 · 604 citations
  88. Event Extraction by Answering (Almost) Natural QuestionsXinya Du, Claire Cardie2020 · 602 citations
  89. RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question AnsweringYingqi Qu, Yuchen Ding, Jing Liu, et al.2021 · 601 citations
  90. Linguistically-Informed Self-Attention for Semantic Role LabelingEmma Strubell, Patrick Verga, Daniel Andor, et al.2018 · 598 citations
  91. Attention Guided Graph Convolutional Networks for Relation ExtractionZhijiang Guo, Yan Zhang, Wei Lu2019 · 597 citations
  92. Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelShaden Smith, Mostofa Patwary, Brandon Norick, et al.2022 · 595 citations
  93. Text Embeddings by Weakly-Supervised Contrastive Pre-trainingLiang Wang, Nan Yang, Xiaolong Huang, et al.2022 · 594 citations
  94. FNet: Mixing Tokens with Fourier TransformsJames Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 593 citations
  95. Dissecting Contextual Word Embeddings: Architecture and RepresentationMatthew E. Peters, Mark Neumann, Luke Zettlemoyer, et al.2018 · 585 citations
  96. AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent ConversationQingyun Wu, Gagan Bansal, Jieyu Zhang, et al.2023 · 584 citations
  97. PAWS: Paraphrase Adversaries from Word ScramblingYuan Zhang, Jason Baldridge, Luheng He2019 · 584 citations
  98. Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text ModelsJianmo Ni, Gustavo Hernandez Abrego, Noah Constant, et al.2021 · 582 citations
  99. What do you learn from context? Probing for sentence structure in contextualized word representationsIan Tenney, Patrick Xia, Berlin Chen, et al.2019 · 582 citations
  100. QANet: Combining Local Convolution with Global Self-Attention for Reading ComprehensionAdams Wei Yu, David Dohan, Minh-Thang Luong, et al.2018 · 581 citations

1 2 3 … 12

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/illia-polosukhin/cited-by/page/2/