Elamur Research⌕
☰
home / papers / Attention Is All You Need / cited by / page 3

Who cites «Attention Is All You Need»

16,413 papers of our library cite it (of the 140,884 whose bibliographies we read) · 993 with a page here, the most cited first · page 3 of 10 · 201–300 · ← the paper

1 2 3 4 … 10

  1. The BEA-2019 Shared Task on Grammatical Error CorrectionChristopher Bryant, Mariano Felice, Øistein E. Andersen, et al.2019 · 530 citations
  2. Simple, Scalable Adaptation for Neural Machine TranslationAnkur Bapna, Orhan Firat2019 · 524 citations
  3. The Natural Language Decathlon: Multitask Learning as Question AnsweringBryan McCann, Nitish Shirish Keskar, Caiming Xiong, et al.2018 · 523 citations
  4. DeCLUTR: Deep Contrastive Learning for Unsupervised Textual RepresentationsJohn Giorgi, Osvald Nitski, Bo Wang, et al.2021 · 513 citations
  5. Baichuan 2: Open Large-scale Language ModelsAiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 512 citations
  6. MLS: A Large-Scale Multilingual Dataset for Speech ResearchVineel Pratap, Qiantong Xu, Anuroop Sriram, et al.2020 · 510 citations
  7. TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, et al.2019 · 508 citations
  8. Marian: Fast Neural Machine Translation in C++Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, et al.2018 · 506 citations
  9. OpenAssistant Conversations — Democratizing Large Language Model AlignmentAndreas Köpf, Yannic Kilcher, Dimitri von Rütte, et al.2023 · 505 citations
  10. Multilingual Machine Translation with Large Language Models: Empirical Results and AnalysisWenhao Zhu, Hongyi Liu, Qingxiu Dong, et al.2024 · 503 citations
  11. FLAT: Chinese NER Using Flat-Lattice TransformerXiaonan Li, Hang Yan, Xipeng Qiu, et al.2020 · 503 citations
  12. Neural Text Generation with Unlikelihood TrainingSean Welleck, Ilia Kulikov, Stephen Roller, et al.2019 · 498 citations
  13. Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data TasksJason Phang, Thibault Févry, Samuel R. Bowman2018 · 490 citations
  14. Phi-4 Technical ReportMarah Abdin, Jyoti Aneja, Harkirat Behl, et al.2024 · 489 citations
  15. DeeBERT: Dynamic Early Exiting for Accelerating BERT InferenceJi Xin, Raphael Tang, Jaejun Lee, et al.2020 · 480 citations
  16. ToTTo: A Controlled Table-To-Text Generation DatasetAnkur Parikh, Xuezhi Wang, Sebastian Gehrmann, et al.2020 · 479 citations
  17. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timeMitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, et al.2022 · 474 citations
  18. GLaM: Efficient Scaling of Language Models with Mixture-of-ExpertsNan Du, Yanping Huang, Andrew M. Dai, et al.2021 · 474 citations
  19. Inference-Time Intervention: Eliciting Truthful Answers from a Language ModelKenneth Li, Oam Patel, Fernanda Viegas, et al.2023 · 473 citations
  20. Improving Massively Multilingual Neural Machine Translation and Zero-Shot TranslationBiao Zhang, Philip Williams, Ivan Titov, et al.2020 · 472 citations
  21. Data Augmentation using Pre-trained Transformer ModelsVarun Kumar, Ashutosh Choudhary, Eunah Cho2020 · 468 citations
  22. Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTShijie Wu, Mark Dredze2019 · 466 citations
  23. Masked Autoencoders Are Scalable Vision LearnersKaiming He, Xinlei Chen, Saining Xie, et al.2021 · 463 citations
  24. CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-XQinkai Zheng, Xiao Xia, Xu Zou, et al.2023 · 462 citations
  25. Hierarchical Transformers for Multi-Document SummarizationYang Liu, Mirella Lapata2019 · 462 citations
  26. From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual TransformersAnne Lauscher, Vinit Ravishankar, Ivan Vulić, et al.2020 · 461 citations
  27. Defending Against Neural Fake NewsRowan Zellers, Ari Holtzman, Hannah Rashkin, et al.2019 · 461 citations
  28. SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionZirui Wang, Jiahui Yu, Adams Wei Yu, et al.2021 · 459 citations
  29. Are All Languages Created Equal in Multilingual BERT?Shijie Wu, Mark Dredze2020 · 458 citations
  30. Graph-to-Sequence Learning using Gated Graph Neural NetworksDaniel Beck, Gholamreza Haffari, Trevor Cohn2018 · 456 citations
  31. OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkPeng Wang, An Yang, Rui Men, et al.2022 · 452 citations
  32. ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-trainingWeizhen Qi, Yu Yan, Yeyun Gong, et al.2020 · 451 citations
  33. Meta-Learning for Low-Resource Neural Machine TranslationJiatao Gu, Yong Wang, Yun Chen, et al.2018 · 451 citations
  34. CogView: Mastering Text-to-Image Generation via TransformersMing Ding, Zhuoyi Yang, Wenyi Hong, et al.2021 · 446 citations
  35. HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document SummarizationXingxing Zhang, Furu Wei, Ming Zhou2019 · 446 citations
  36. Context-Aware Neural Machine Translation Learns Anaphora ResolutionElena Voita, Pavel Serdyukov, Rico Sennrich, et al.2018 · 446 citations
  37. FinGPT: Open-Source Financial Large Language ModelsHongyang Yang, Xiao-Yang Liu, Christina Dan Wang2023 · 445 citations
  38. GeDi: Generative Discriminator Guided Sequence GenerationBen Krause, Akhilesh Deepak Gotmare, Bryan McCann, et al.2021 · 444 citations
  39. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsPhillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 444 citations
  40. Masked Language Model ScoringJulian Salazar, Davis Liang, Toan Q. Nguyen, et al.2020 · 444 citations
  41. Mathematical Capabilities of ChatGPTSimon Frieder, Luca Pinchetti, Alexis Chevalier, et al.2023 · 443 citations
  42. Has Machine Translation Achieved Human Parity? A Case for Document-level EvaluationSamuel Läubli, Rico Sennrich, Martin Volk2018 · 443 citations
  43. Pretrained Transformers Improve Out-of-Distribution RobustnessDan Hendrycks, Xiaoyuan Liu, Eric Wallace, et al.2020 · 442 citations
  44. ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 441 citations
  45. Measuring Coding Challenge Competence With APPSDan Hendrycks, Steven Basart, Saurav Kadavath, et al.2021 · 438 citations
  46. Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine TranslationMatt Post, David Vilar2018 · 437 citations
  47. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  48. MuST-C: a Multilingual Speech Translation CorpusMattia A. Di Gangi, Roldano Cattoni, Luisa Bentivogli, et al.2019 · 436 citations
  49. oLMpics — On what Language Model Pre-training CapturesAlon Talmor, Yanai Elazar, Yoav Goldberg, et al.2019 · 432 citations
  50. Unsupervised Statistical Machine TranslationMikel Artetxe, Gorka Labaka, Eneko Agirre2018 · 432 citations
  51. Analyzing the Structure of Attention in a Transformer Language ModelJesse Vig, Yonatan Belinkov2019 · 430 citations
  52. Experience Grounds LanguageYonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 429 citations
  53. Sequicity: Simplifying Task-oriented Dialogue Systems with Single Sequence-to-Sequence ArchitecturesWenqiang Lei, Xisen Jin, Min-Yen Kan, et al.2018 · 426 citations
  54. Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware SamplingSebastian Hofstatter, Sheng-Chieh Lin, Jheng-Hong Yang, et al.2021 · 425 citations
  55. Controllable Abstractive SummarizationAngela Fan, David Grangier, Michael Auli2018 · 423 citations
  56. Security and Privacy Challenges of Large Language Models: A SurveyBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 422 citations
  57. Diffusion-LM Improves Controllable Text GenerationXiang Lisa Li, John Thickstun, Ishaan Gulrajani, et al.2022 · 421 citations
  58. Ethical and social risks of harm from Language ModelsLaura Weidinger, John Mellor, Maribeth Rauh, et al.2021 · 421 citations
  59. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied AgentsWenlong Huang, Pieter Abbeel, Deepak Pathak, et al.2022 · 420 citations
  60. Template-Based Named Entity Recognition Using BARTLeyang Cui, Yu Wu, Jian Liu, et al.2021 · 420 citations
  61. ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual LearningViet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, et al.2023 · 418 citations
  62. Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsArtidoro Pagnoni, Vidhisha Balachandran, Yulia Tsvetkov2021 · 417 citations
  63. Pay Less Attention with Lightweight and Dynamic ConvolutionsFelix Wu, Angela Fan, Alexei Baevski, et al.2019 · 416 citations
  64. 75 Languages, 1 Model: Parsing Universal Dependencies UniversallyDan Kondratyuk, Milan Straka2019 · 415 citations
  65. Kimi k1.5: Scaling Reinforcement Learning with LLMsKimi Team, Angang Du, Bofei Gao, et al.2025 · 413 citations
  66. High Fidelity Neural Audio CompressionAlexandre Defossez, Jade Copet, Gabriel Synnaeve, et al.2022 · 412 citations
  67. Are Sixteen Heads Really Better than One?Paul Michel, Omer Levy, Graham Neubig2019 · 412 citations
  68. Document-Level Neural Machine Translation with Hierarchical Attention NetworksLesly Miculicich, Dhananjay Ram, Nikolaos Pappas, et al.2018 · 411 citations
  69. A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health SupportAshish Sharma, Adam Miner, David Atkins, et al.2020 · 408 citations
  70. Multi-Turn Response Selection for Chatbots with Deep Attention Matching NetworkXiangyang Zhou, Lu Li, Daxiang Dong, et al.2018 · 408 citations
  71. Automatic Detection of Generated Text is Easiest when Humans are FooledDaphne Ippolito, Daniel Duckworth, Chris Callison-Burch, et al.2019 · 406 citations
  72. Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, et al.2020 · 405 citations
  73. The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleGuilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 404 citations
  74. Generating Sentences by Editing PrototypesKelvin Guu, Tatsunori B. Hashimoto, Yonatan Oren, et al.2017 · 404 citations
  75. Yi: Open Foundation Models by 01.AIAlex Young, Bei Chen, Chao Li, et al.2024 · 402 citations
  76. Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog SystemsAndrea Madotto, Chien-Sheng Wu, Pascale Fung2018 · 401 citations
  77. Compressing BERT: Studying the Effects of Weight Pruning on Transfer LearningMitchell Gordon, Kevin Duh, Nicholas Andrews2020 · 400 citations
  78. How to Fine-Tune BERT for Text Classification?Chi Sun, Xipeng Qiu, Yige Xu, et al.2019 · 400 citations
  79. A Survey on Recent Approaches for Natural Language Processing in Low-Resource ScenariosMichael A. Hedderich, Lukas Lange, Heike Adel, et al.2021 · 399 citations
  80. LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language ModelsZhiqiang Hu, Lei Wang, Yihuai Lan, et al.2023 · 398 citations
  81. FLEURS: Few-shot Learning Evaluation of Universal Representations of SpeechAlexis Conneau, Min Ma, Simran Khanuja, et al.2022 · 398 citations
  82. LongT5: Efficient Text-To-Text Transformer for Long SequencesMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 398 citations
  83. QMSum: A New Benchmark for Query-based Multi-domain Meeting SummarizationMing Zhong, Da Yin, Tao Yu, et al.2021 · 397 citations
  84. A Unified Generative Framework for Aspect-based Sentiment AnalysisHang Yan, Junqi Dai, Tuo Ji, et al.2021 · 396 citations
  85. Long Range Arena: A Benchmark for Efficient TransformersYi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 396 citations
  86. A Challenge Dataset and Effective Models for Aspect-Based Sentiment AnalysisQingnan Jiang, Lei Chen, Ruifeng Xu, et al.2019 · 393 citations
  87. A Unified Generative Framework for Various NER SubtasksHang Yan, Tao Gui, Junqi Dai, et al.2021 · 392 citations
  88. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsElad Ben-Zaken, Shauli Ravfogel, Yoav Goldberg2021 · 388 citations
  89. RULER: What's the Real Context Size of Your Long-Context Language Models?Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 386 citations
  90. German's Next Language ModelBranden Chan, Stefan Schweter, Timo Möller2020 · 385 citations
  91. A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language UnderstandingLibo Qin, Wanxiang Che, Yangming Li, et al.2019 · 384 citations
  92. Deep Semantic Role Labeling with Self-AttentionZhixing Tan, Mingxuan Wang, Jun Xie, et al.2017 · 384 citations
  93. Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling MechanismsDinghan Shen, Guoyin Wang, Wenlin Wang, et al.2018 · 383 citations
  94. Retrieval Augmentation Reduces Hallucination in ConversationKurt Shuster, Spencer Poff, Moya Chen, et al.2021 · 382 citations
  95. Discourse-Aware Neural Extractive Text SummarizationJiacheng Xu, Zhe Gan, Yu Cheng, et al.2019 · 382 citations
  96. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingHangbo Bao, Li Dong, Furu Wei, et al.2020 · 380 citations
  97. Reasoning with Latent Structure Refinement for Document-Level Relation ExtractionGuoshun Nan, Zhijiang Guo, Ivan Sekulic, et al.2020 · 379 citations
  98. ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading ComprehensionSheng Zhang, Xiaodong Liu, Jingjing Liu, et al.2018 · 379 citations
  99. Towards General Text Embeddings with Multi-stage Contrastive LearningZehan Li, Xin Zhang, Yanzhao Zhang, et al.2023 · 378 citations
  100. Emerging Cross-lingual Structure in Pretrained Language ModelsAlexis Conneau, Shijie Wu, Haoran Li, et al.2020 · 378 citations

1 2 3 4 … 10

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/cited-by/page/3/