Elamur Research⌕
☰
home / papers / Attention Is All You Need / cited by / page 4

Who cites «Attention Is All You Need»

16,413 papers of our library cite it (of the 140,884 whose bibliographies we read) · 993 with a page here, the most cited first · page 4 of 10 · 301–400 · ← the paper

1 2 3 4 5 … 10

  1. ETC: Encoding Long and Structured Inputs in TransformersJoshua Ainslie, Santiago Ontañón, Chris Alberti, et al.2020 · 377 citations
  2. Tool Learning with Foundation ModelsYujia Qin, Shengding Hu, Yankai Lin, et al.2023 · 376 citations
  3. FastBERT: a Self-distilling BERT with Adaptive Inference TimeWeijie Liu, Peng Zhou, Zhiruo Wang, et al.2020 · 374 citations
  4. ChatDev: Communicative Agents for Software DevelopmentChen Qian, Wei Liu, Hongzhang Liu, et al.2023 · 373 citations
  5. A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersPradeep Dasigi, Kyle Lo, Iz Beltagy, et al.2021 · 372 citations
  6. Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event ExtractionYaojie Lu, Hongyu Lin, Jin Xu, et al.2021 · 370 citations
  7. Green AIRoy Schwartz, Jesse Dodge, Noah A. Smith, et al.2019 · 370 citations
  8. Knowledge-Enriched Transformer for Emotion Detection in Textual ConversationsPeixiang Zhong, Di Wang, Chunyan Miao2019 · 370 citations
  9. Training Tips for the Transformer ModelMartin Popel, Ondřej Bojar2018 · 369 citations
  10. Heterogeneous Graph Neural Networks for Extractive Document SummarizationDanqing Wang, Pengfei Liu, Yining Zheng, et al.2020 · 368 citations
  11. VILA: On Pre-training for Visual Language ModelsJi Lin, Hongxu Yin, Wei Ping, et al.2023 · 367 citations
  12. Massively Multilingual Neural Machine TranslationRoee Aharoni, Melvin Johnson, Orhan Firat2019 · 367 citations
  13. A Survey on Large Language Models for Code GenerationJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 366 citations
  14. An Analysis of Encoder Representations in Transformer-Based Machine TranslationAlessandro Raganato, Jörg Tiedemann2018 · 366 citations
  15. The AI Scientist: Towards Fully Automated Open-Ended Scientific DiscoveryChris Lu, Cong Lu, Robert Tjarko Lange, et al.2024 · 362 citations
  16. Revisiting Few-sample BERT Fine-tuningTianyi Zhang, Felix Wu, Arzoo Katiyar, et al.2020 · 361 citations
  17. The FLORES Evaluation Datasets for Low-Resource Machine Translation: Nepali–English and Sinhala–EnglishFrancisco Guzmán, Peng-Jen Chen, Myle Ott, et al.2019 · 361 citations
  18. TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented DialogueChien-Sheng Wu, Steven C.H. Hoi, Richard Socher, et al.2020 · 360 citations
  19. Mind the GAP: A Balanced Corpus of Gendered Ambiguous PronounsKellie Webster, Marta Recasens, Vera Axelrod, et al.2018 · 358 citations
  20. BERTje: A Dutch BERT ModelWietse de Vries, Andreas van Cranenburgh, Arianna Bisazza, et al.2019 · 357 citations
  21. Universal Neural Machine Translation for Extremely Low Resource LanguagesJiatao Gu, Hany Hassan, Jacob Devlin, et al.2018 · 356 citations
  22. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 355 citations
  23. Large Language Models Struggle to Learn Long-Tail KnowledgeNikhil Kandpal, Haikang Deng, Adam Roberts, et al.2022 · 352 citations
  24. TinyLlama: An Open-Source Small Language ModelPeiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 350 citations
  25. STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix FrameworkMingbo Ma, Liang Huang, Hao Xiong, et al.2019 · 349 citations
  26. Reformulating Unsupervised Style Transfer as Paraphrase GenerationKalpesh Krishna, John Wieting, Mohit Iyyer2020 · 348 citations
  27. RobBERT: a Dutch RoBERTa-based Language ModelPieter Delobelle, Thomas Winters, Bettina Berendt2020 · 346 citations
  28. Directed Acyclic Graph Network for Conversational Emotion RecognitionWeizhou Shen, Siyue Wu, Yunyi Yang, et al.2021 · 344 citations
  29. Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary SpaceMor Geva, Avi Caciularu, Kevin Ro Wang, et al.2022 · 342 citations
  30. PaLI: A Jointly-Scaled Multilingual Language-Image ModelXi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 339 citations
  31. Visualizing and Measuring the Geometry of BERTAndy Coenen, Emily Reif, Ann Yuan, et al.2019 · 338 citations
  32. Large Language Models for Information Retrieval: A SurveyYutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen2023 · 335 citations
  33. Efficient Attentions for Long Document SummarizationLuyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 334 citations
  34. DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsDeepSeek-AI, Aixin Liu, Aoxue Mei, et al.2025 · 333 citations
  35. Kimi K2: Open Agentic IntelligenceKimi Team, Yifan Bai, Yiping Bao, et al.2025 · 331 citations
  36. Scaling Speech Technology to 1,000+ LanguagesVineel Pratap, Andros Tjandra, Bowen Shi, et al.2023 · 331 citations
  37. GraphCodeBERT: Pre-training Code Representations with Data FlowDaya Guo, Shuo Ren, Shuai Lu, et al.2021 · 328 citations
  38. Textbooks Are All You Need II: phi-1.5 technical reportYuanzhi Li, Sébastien Bubeck, Ronen Eldan, et al.2023 · 327 citations
  39. Unsupervised Domain Clusters in Pretrained Language ModelsRoee Aharoni, Yoav Goldberg2020 · 326 citations
  40. CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared TaskRicardo Rei, Marcos Treviso, Nuno M. Guerreiro, et al.2022 · 325 citations
  41. Aspect Sentiment Quad Prediction as Paraphrase GenerationWenxuan Zhang, Yang Deng, Xin Li, et al.2021 · 325 citations
  42. Are Emergent Abilities of Large Language Models a Mirage?Rylan Schaeffer, Brando Miranda, Sanmi Koyejo2023 · 323 citations
  43. Robust Neural Machine Translation with Doubly Adversarial InputsYong Cheng, Lu Jiang, Wolfgang Macherey2019 · 321 citations
  44. When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical CohesionElena Voita, Rico Sennrich, Ivan Titov2019 · 321 citations
  45. "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language ModelsXinyue Shen, Zeyuan Chen, Michael Backes, et al.2023 · 320 citations
  46. Probing Pretrained Language Models for Lexical SemanticsIvan Vulić, Edoardo Maria Ponti, Robert Litschko, et al.2020 · 320 citations
  47. Compressive Transformers for Long-Range Sequence ModellingJack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, et al.2019 · 320 citations
  48. GSum: A General Framework for Guided Neural Abstractive SummarizationZi-Yi Dou, Pengfei Liu, Hiroaki Hayashi, et al.2021 · 317 citations
  49. Document Expansion by Query PredictionRodrigo Nogueira, Wei Yang, Jimmy Lin, et al.2019 · 317 citations
  50. Text and Code Embeddings by Contrastive Pre-TrainingArvind Neelakantan, Tao Xu, Raul Puri, et al.2022 · 316 citations
  51. Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation ModelsChenfei Wu, Shengming Yin, Weizhen Qi, et al.2023 · 315 citations
  52. A Transformer-based approach to Irony and Sarcasm detectionRolandos Alexandros Potamias, Georgios Siolas, Andreas - Georgios Stafylopatis2019 · 312 citations
  53. Hallucination is Inevitable: An Innate Limitation of Large Language ModelsZiwei Xu, Sanjay Jain, Mohan Kankanhalli2024 · 309 citations
  54. Generating Wikipedia by Summarizing Long SequencesPeter J. Liu, Mohammad Saleh, Etienne Pot, et al.2018 · 308 citations
  55. Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic LanguagesGowtham Ramesh, Sumanth Doddapaneni, Aravinth Bheemaraj, et al.2022 · 307 citations
  56. TIES-Merging: Resolving Interference When Merging ModelsPrateek Yadav, Derek Tam, Leshem Choshen, et al.2023 · 306 citations
  57. Multi-hop Reading Comprehension through Question Decomposition and RescoringSewon Min, Victor Zhong, Luke Zettlemoyer, et al.2019 · 306 citations
  58. Discovering Language Model Behaviors with Model-Written EvaluationsEthan Perez, Sam Ringer, Kamilė Lukošiūtė, et al.2022 · 305 citations
  59. Good-Enough Compositional Data AugmentationJacob Andreas2020 · 305 citations
  60. Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defenseKalpesh Krishna, Yixiao Song, Marzena Karpinska, et al.2023 · 304 citations
  61. Carbon Emissions and Large Neural Network TrainingDavid Patterson, Joseph Gonzalez, Quoc Le, et al.2021 · 304 citations
  62. A Survey of Domain Adaptation for Neural Machine TranslationChenhui Chu, Rui Wang2018 · 304 citations
  63. UDPipe 2.0 Prototype at CoNLL 2018 UD Shared TaskMilan Straka2018 · 303 citations
  64. AugGPT: Leveraging ChatGPT for Text Data AugmentationHaixing Dai; Zhengliang Liu; Wenxiong Liao; Xiaoke Huang; Yihan Cao; Zihao Wu; Lin Zhao; Shaochen Xu; Wei Liu; Ninghao Liu; Sheng Li; Dajiang Zhu; Hongmin Cai; Lichao Sun; Quanzheng Li; Dinggang Shen; Tianming Liu;, Xiang Li2023 · 302 citations
  65. ZeRO-Offload: Democratizing Billion-Scale Model TrainingJie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.2021 · 302 citations
  66. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale TransformersZhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, et al.2022 · 301 citations
  67. DialogSum: A Real-Life Scenario Dialogue Summarization DatasetYulong Chen, Yang Liu, Liang Chen, et al.2021 · 301 citations
  68. MoEL: Mixture of Empathetic ListenersZhaojiang Lin, Andrea Madotto, Jamin Shin, et al.2019 · 301 citations
  69. Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
  70. Style Transformer: Unpaired Text Style Transfer without Disentangled Latent RepresentationNing Dai, Jianze Liang, Xipeng Qiu, et al.2019 · 300 citations
  71. InternLM2 Technical ReportZheng Cai, Maosong Cao, Haojiong Chen, et al.2024 · 299 citations
  72. ALFWorld: Aligning Text and Embodied Environments for Interactive LearningMohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, et al.2020 · 299 citations
  73. Bridging the Gap between Training and Inference for Neural Machine TranslationWen Zhang, Yang Feng, Fandong Meng, et al.2019 · 298 citations
  74. Paraphrase Generation with Deep Reinforcement LearningZichao Li, Xin Jiang, Lifeng Shang, et al.2018 · 298 citations
  75. Multimodal Chain-of-Thought Reasoning in Language ModelsZhuosheng Zhang, Aston Zhang, Mu Li, et al.2023 · 296 citations
  76. Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question AnsweringYanlin Feng, Xinyue Chen, Bill Yuchen Lin, et al.2020 · 295 citations
  77. Matching the Blanks: Distributional Similarity for Relation LearningLivio Baldini Soares, Nicholas FitzGerald, Jeffrey Ling, et al.2019 · 294 citations
  78. FlauBERT: Unsupervised Language Model Pre-training for FrenchHang Le, Loïc Vial, Jibril Frej, et al.2019 · 293 citations
  79. Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, et al.2023 · 292 citations
  80. SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized OptimizationHaoming Jiang, Pengcheng He, Weizhu Chen, et al.2020 · 291 citations
  81. CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement LearningHung Le, Yue Wang, Akhilesh Deepak Gotmare, et al.2022 · 290 citations
  82. From Words to Watts: Benchmarking the Energy Costs of Large Language Model InferenceSiddharth Samsi, Dan Zhao, Joseph McDonald, et al.2023 · 288 citations
  83. Can language models learn from explanations in context?Andrew Lampinen, Ishita Dasgupta, Stephanie Chan, et al.2022 · 288 citations
  84. SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine TranslationXinyi Wang, Hieu Pham, Zihang Dai, et al.2018 · 287 citations
  85. Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence EncodersJue Wang, Wei Lu2020 · 286 citations
  86. Efficient and Effective Text Encoding for Chinese LLaMA and AlpacaYiming Cui, Ziqing Yang, Xin Yao2023 · 285 citations
  87. Text Generation from Knowledge Graphs with Graph TransformersRik Koncel-Kedziorski, Dhanush Bekal, Yi Luan, et al.2019 · 284 citations
  88. ReClor: A Reading Comprehension Dataset Requiring Logical ReasoningWeihao Yu, Zihang Jiang, Yanfei Dong, et al.2020 · 283 citations
  89. USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationShikib Mehri, Maxine Eskenazi2020 · 283 citations
  90. Analysing Mathematical Reasoning Abilities of Neural ModelsDavid Saxton, Edward Grefenstette, Felix Hill, et al.2019 · 282 citations
  91. Jointly Predicting Predicates and Arguments in Neural Semantic Role LabelingLuheng He, Kenton Lee, Omer Levy, et al.2018 · 282 citations
  92. Semantic Parsing for Task Oriented Dialog using Hierarchical RepresentationsSonal Gupta, Rushin Shah, Mrinal Mohit, et al.2018 · 280 citations
  93. BAM! Born-Again Multi-Task Networks for Natural Language UnderstandingKevin Clark, Minh-Thang Luong, Urvashi Khandelwal, et al.2019 · 279 citations
  94. RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQLHaoyang Li, Jing Zhang, Cuiping Li, et al.2023 · 277 citations
  95. XTREME-R: Towards More Challenging and Nuanced Multilingual EvaluationSebastian Ruder, Noah Constant, Jan Botha, et al.2021 · 277 citations
  96. MIME: MIMicking Emotions for Empathetic Response GenerationNavonil Majumder, Pengfei Hong, Shanshan Peng, et al.2020 · 277 citations
  97. An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language ModelsLiang Chen, Haozhe Zhao, Tianyu Liu, et al.2024 · 276 citations
  98. Large Dual Encoders Are Generalizable RetrieversJianmo Ni, Chen Qu, Jing Lu, et al.2021 · 276 citations
  99. A Diagnostic Study of Explainability Techniques for Text ClassificationPepa Atanasova, Jakob Grue Simonsen, Christina Lioma, et al.2020 · 273 citations
  100. Adaptively Sparse TransformersGonçalo M. Correia, Vlad Niculae, André F. T. Martins2019 · 270 citations

1 2 3 4 5 … 10

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/cited-by/page/4/