Elamur Research⌕
☰
home / papers / Attention Is All You Need / cited by / page 2

Who cites «Attention Is All You Need»

16,413 papers of our library cite it (of the 140,884 whose bibliographies we read) · 993 with a page here, the most cited first · page 2 of 10 · 101–200 · ← the paper

1 2 3 … 10

  1. MTEB: Massive Text Embedding BenchmarkNiklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,021 citations
  2. A Discourse-Aware Attention Model for Abstractive Summarization of Long DocumentsArman Cohan, Franck Dernoncourt, Doo Soon Kim, et al.2018 · 1,018 citations
  3. Linguistic Knowledge and Transferability of Contextual RepresentationsNelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,011 citations
  4. VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsWeijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,008 citations
  5. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, et al.2019 · 1,006 citations
  6. Attention is not ExplanationSarthak Jain, Byron C. Wallace2019 · 997 citations
  7. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 992 citations
  8. ERNIE 2.0: A Continual Pre-training Framework for Language UnderstandingYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 976 citations
  9. PaLM 2 Technical ReportRohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 971 citations
  10. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 962 citations
  11. ERNIE: Enhanced Representation through Knowledge IntegrationYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 949 citations
  12. AdapterFusion: Non-Destructive Task Composition for Transfer LearningJonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé, et al.2020 · 948 citations
  13. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, et al.2020 · 944 citations
  14. ImageBind: One Embedding Space To Bind Them AllRohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, et al.2023 · 943 citations
  15. Patient Knowledge Distillation for BERT Model CompressionSiqi Sun, Yu Cheng, Zhe Gan, et al.2019 · 939 citations
  16. Bottom-Up Abstractive SummarizationSebastian Gehrmann, Yuntian Deng, Alexander Rush2018 · 939 citations
  17. Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesGheorghe Comanici, Eric Bieber, Mike Schaekermann, et al.2025 · 906 citations
  18. Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 901 citations
  19. Is Attention Interpretable?Sofia Serrano, Noah A. Smith2019 · 885 citations
  20. Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal2021 · 882 citations
  21. Do As I Can, Not As I Say: Grounding Language in Robotic AffordancesMichael Ahn, Anthony Brohan, Noah Brown, et al.2022 · 873 citations
  22. Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, et al.2023 · 865 citations
  23. ChatGPT: Jack of all trades, master of noneJan Kocon, Igor Cichecki, Oliwier Kaszyca, et al.2023 · 863 citations
  24. Findings of the 2019 Conference on Machine Translation (WMT19)Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, et al.2019 · 839 citations
  25. MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferJonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 831 citations
  26. On the Sentence Embeddings from Pre-trained Language ModelsBohan Li, Hao Zhou, Junxian He, et al.2020 · 830 citations
  27. DocVQA: A Dataset for VQA on Document ImagesMinesh Mathew, Dimosthenis Karatzas, C.V. Jawahar2020 · 820 citations
  28. Scaling Neural Machine TranslationMyle Ott, Sergey Edunov, David Grangier, et al.2018 · 813 citations
  29. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 799 citations
  30. Achieving Human Parity on Automatic Chinese to English News TranslationHany Hassan, Anthony Aue, Chang Chen, et al.2018 · 794 citations
  31. Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, et al.2020 · 788 citations
  32. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital ReadmissionKexin Huang, Jaan Altosaar, Rajesh Ranganath2019 · 788 citations
  33. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
  34. LayoutLMv3: Pre-training for Document AI with Unified Text and Image MaskingYupan Huang, Tengchao Lv, Lei Cui, et al.2022 · 774 citations
  35. Reformer: The Efficient TransformerNikita Kitaev, Łukasz Kaiser, Anselm Levskaya2020 · 774 citations
  36. Non-Autoregressive Neural Machine TranslationJiatao Gu, James Bradbury, Caiming Xiong, et al.2017 · 765 citations
  37. ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionWonjae Kim, Bokyung Son, Ildoo Kim2021 · 762 citations
  38. Constituency Parsing with a Self-Attentive EncoderNikita Kitaev, Dan Klein2018 · 759 citations
  39. AdapterHub: A Framework for Adapting TransformersJonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.2020 · 747 citations
  40. Findings of the 2018 Conference on Machine Translation (WMT18)Ondřej Bojar, Christian Federmann, Mark Fishel, et al.2018 · 747 citations
  41. Unified Pre-training for Program Understanding and GenerationWasi Ahmad, Saikat Chakraborty, Baishakhi Ray, et al.2021 · 746 citations
  42. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 744 citations
  43. Integrating Multimodal Information in Large Pretrained TransformersWasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.2020 · 742 citations
  44. Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical ModelAlexander Fabbri, Irene Li, Tianwei She, et al.2019 · 738 citations
  45. Revealing the Dark Secrets of BERTOlga Kovaleva, Alexey Romanov, Anna Rogers, et al.2019 · 737 citations
  46. Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningHaokun Liu, Derek Tam, Mohammed Muqeeth, et al.2022 · 735 citations
  47. A Novel Cascade Binary Tagging Framework for Relational Triple ExtractionZhepei Wei, Jianlin Su, Yue Wang, et al.2020 · 732 citations
  48. Triton: An Intermediate Language and Compiler for Tiled Neural Network ComputationsPhilippe Tillet, H. T. Kung, David Cox2019 · 728 citations
  49. SGLang: Efficient Execution of Structured Language Model ProgramsLianmin Zheng, Liangsheng Yin, Zhiqiang Xie, et al.2023 · 710 citations
  50. A Multiscale Visualization of Attention in the Transformer ModelJesse Vig2019 · 708 citations
  51. Capabilities of GPT-4 on Medical Challenge ProblemsHarsha Nori, Nicholas King, Scott Mayer McKinney, et al.2023 · 700 citations
  52. Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 692 citations
  53. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, et al.2020 · 690 citations
  54. TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, et al.2020 · 690 citations
  55. Explain Yourself! Leveraging Language Models for Commonsense ReasoningNazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.2019 · 690 citations
  56. DialoGPT: Large-Scale Generative Pre-training for Conversational Response GenerationYizhe Zhang, Siqi Sun, Michel Galley, et al.2019 · 684 citations
  57. ELI5: Long Form Question AnsweringAngela Fan, Yacine Jernite, Ethan Perez, et al.2019 · 682 citations
  58. Social Bias Frames: Reasoning about Social and Power Implications of LanguageMaarten Sap, Saadia Gabriel, Lianhui Qin, et al.2020 · 680 citations
  59. Large Language Models Are Human-Level Prompt EngineersYongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.2022 · 677 citations
  60. Mask-Predict: Parallel Decoding of Conditional Masked Language ModelsMarjan Ghazvininejad, Omer Levy, Yinhan Liu, et al.2019 · 671 citations
  61. Well-Read Students Learn Better: On the Importance of Pre-training Compact ModelsIulia Turc, Ming-Wei Chang, Kenton Lee, et al.2019 · 671 citations
  62. K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan, et al.2020 · 662 citations
  63. Similarity of Neural Network Representations RevisitedSimon Kornblith, Mohammad Norouzi, Honglak Lee, et al.2019 · 661 citations
  64. Efficient Content-Based Sparse Attention with Routing TransformersAurko Roy, Mohammad Saffar, Ashish Vaswani, et al.2020 · 660 citations
  65. CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataGuillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.2020 · 650 citations
  66. CodeSearchNet Challenge: Evaluating the State of Semantic Code SearchHamel Husain, Ho-Hsiang Wu, Tiferet Gazit, et al.2020 · 647 citations
  67. CoCa: Contrastive Captioners are Image-Text Foundation ModelsJiahui Yu, Zirui Wang, Vijay Vasudevan, et al.2022 · 646 citations
  68. Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code GenerationJiawei Liu, Chunqiu Steven Xia, Yuyao Wang, et al.2023 · 632 citations
  69. Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and BeyondMikel Artetxe, Holger Schwenk2018 · 627 citations
  70. BloombergGPT: A Large Language Model for FinanceShijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 608 citations
  71. Role-Play with Large Language ModelsMurray Shanahan, Kyle McDonell, Laria Reynolds2023 · 606 citations
  72. Towards a Unified View of Parameter-Efficient Transfer LearningJunxian He, Chunting Zhou, Xuezhe Ma, et al.2021 · 604 citations
  73. Linguistically-Informed Self-Attention for Semantic Role LabelingEmma Strubell, Patrick Verga, Daniel Andor, et al.2018 · 598 citations
  74. Attention Guided Graph Convolutional Networks for Relation ExtractionZhijiang Guo, Yan Zhang, Wei Lu2019 · 597 citations
  75. Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelShaden Smith, Mostofa Patwary, Brandon Norick, et al.2022 · 595 citations
  76. FNet: Mixing Tokens with Fourier TransformsJames Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 593 citations
  77. Dissecting Contextual Word Embeddings: Architecture and RepresentationMatthew E. Peters, Mark Neumann, Luke Zettlemoyer, et al.2018 · 585 citations
  78. PAWS: Paraphrase Adversaries from Word ScramblingYuan Zhang, Jason Baldridge, Luheng He2019 · 584 citations
  79. Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text ModelsJianmo Ni, Gustavo Hernandez Abrego, Noah Constant, et al.2021 · 582 citations
  80. What do you learn from context? Probing for sentence structure in contextualized word representationsIan Tenney, Patrick Xia, Berlin Chen, et al.2019 · 582 citations
  81. QANet: Combining Local Convolution with Global Self-Attention for Reading ComprehensionAdams Wei Yu, David Dohan, Minh-Thang Luong, et al.2018 · 581 citations
  82. OCR-free Document Understanding TransformerGeewook Kim, Teakgyu Hong, Moonbin Yim, et al.2021 · 580 citations
  83. Towards a Human-like Open-Domain ChatbotDaniel Adiwardana, Minh-Thang Luong, David R. So, et al.2020 · 573 citations
  84. Multilingual Universal Sentence Encoder for Semantic RetrievalYinfei Yang, Daniel Cer, Amin Ahmad, et al.2020 · 571 citations
  85. PhoBERT: Pre-trained language models for VietnameseDat Quoc Nguyen, Anh Tuan Nguyen2020 · 571 citations
  86. AudioLM: a Language Modeling Approach to Audio GenerationZalan Borsos, Raphael Marinier, Damien Vincent, et al.2022 · 570 citations
  87. Leveraging Pre-trained Checkpoints for Sequence Generation TasksSascha Rothe, Shashi Narayan, Aliaksei Severyn2019 · 562 citations
  88. Plug and Play Language Models: A Simple Approach to Controlled Text GenerationSumanth Dathathri, Andrea Madotto, Janice Lan, et al.2019 · 562 citations
  89. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword CandidatesTaku Kudo2018 · 561 citations
  90. Galactica: A Large Language Model for ScienceRoss Taylor, Marcin Kardas, Guillem Cucurull, et al.2022 · 558 citations
  91. Neural Legal Judgment Prediction in EnglishIlias Chalkidis, Ion Androutsopoulos, Nikolaos Aletras2019 · 558 citations
  92. gpt-oss-120b & gpt-oss-20b Model CardOpenAI: Sandhini Agarwal, Lama Ahmad, Jason Ai, et al.2025 · 555 citations
  93. Massively Multilingual Neural Machine Translation in the Wild: Findings and ChallengesNaveen Arivazhagan, Ankur Bapna, Orhan Firat, et al.2019 · 555 citations
  94. Neural Text Summarization: A Critical EvaluationWojciech Kryscinski, Nitish Shirish Keskar, Bryan McCann, et al.2019 · 555 citations
  95. The Best of Both Worlds: Combining Recent Advances in Neural Machine TranslationMia Xu Chen, Orhan Firat, Ankur Bapna, et al.2018 · 552 citations
  96. XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual GeneralizationJunjie Hu, Sebastian Ruder, Aditya Siddhant, et al.2020 · 551 citations
  97. How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and DetectionBiyang Guo, Xin Zhang, Ziyuan Wang, et al.2023 · 549 citations
  98. Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative RefinementJason Lee, Elman Mansimov, Kyunghyun Cho2018 · 547 citations
  99. Reducing Transformer Depth on Demand with Structured DropoutAngela Fan, Edouard Grave, Armand Joulin2019 · 546 citations
  100. Document Ranking with a Pretrained Sequence-to-Sequence ModelRodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, et al.2020 · 538 citations

1 2 3 … 10

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/cited-by/page/2/