Who cites «Attention Is All You Need»
- Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingYu Meng, Jiaxin Huang, Yu Zhang, et al.2022 · 206 citations
- Reasoning with Multimodal Sarcastic Tweets via Modeling Cross-Modality Contrast and Semantic AssociationNan Xu, Zhixiong Zeng, Wenji Mao2020 · 206 citations
- Entities as Experts: Sparse Memory Access with Entity SupervisionThibault Févry, Livio Baldini Soares, Nicholas FitzGerald, et al.2020 · 205 citations
- Entity-level Factual Consistency of Abstractive Text SummarizationFeng Nan, Ramesh Nallapati, Zhiguo Wang, et al.2021 · 204 citations
- On the Effectiveness of Adapter-based Tuning for Pretrained Language Model AdaptationRuidan He, Linlin Liu, Hai Ye, et al.2021 · 204 citations
- On Exposure Bias, Hallucination and Domain Shift in Neural Machine TranslationChaojun Wang, Rico Sennrich2020 · 204 citations
- mGPT: Few-Shot Learners Go MultilingualOleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
- Contextualizing Hate Speech Classifiers with Post-hoc ExplanationBrendan Kennedy, Xisen Jin, Aida Mostafazadeh Davani, et al.2020 · 203 citations
- SALMONN: Towards Generic Hearing Abilities for Large Language ModelsChangli Tang, Wenyi Yu, Guangzhi Sun, et al.2023 · 202 citations
- Autoformalization with Large Language ModelsYuhuai Wu, Albert Q. Jiang, Wenda Li, et al.2022 · 202 citations
- An Effective Approach to Unsupervised Machine TranslationMikel Artetxe, Gorka Labaka, Eneko Agirre2019 · 202 citations
- AraT5: Text-to-Text Transformers for Arabic Language GenerationEl Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed2022 · 201 citations
- Recursively Summarizing Books with Human FeedbackJeff Wu, Long Ouyang, Daniel M. Ziegler, et al.2021 · 201 citations
- IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesJay Gala, Pranjal A. Chitale, Raghavan AK, et al.2023 · 200 citations
- Dual Conditional Cross-Entropy Filtering of Noisy Parallel CorporaMarcin Junczys-Dowmunt2018 · 200 citations
- End-to-End Non-Autoregressive Neural Machine Translation with Connectionist Temporal ClassificationJindřich Libovický, Jindřich Helcl2018 · 200 citations
- CTRLsum: Towards Generic Controllable Text SummarizationJunxian He, Wojciech Kryscinski, Bryan McCann, et al.2022 · 199 citations
- Jointly Learning to Align and Translate with Transformer ModelsSarthak Garg, Stephan Peitz, Udhyakumar Nallasamy, et al.2019 · 199 citations
- A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsMd Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.2023 · 198 citations
- Improved Lexically Constrained Decoding for Translation and Monolingual RewritingJ. Edward Hu, Huda Khayrallah, Ryan Culkin, et al.2019 · 198 citations
- On NMT Search Errors and Model Errors: Cat Got Your Tongue?Felix Stahlberg, Bill Byrne2019 · 197 citations
- COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingYu Meng, Chenyan Xiong, Payal Bajaj, et al.2021 · 196 citations
- Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation ProblemDanielle Saunders, Bill Byrne2020 · 196 citations
- Structured Pruning of Large Language ModelsZiheng Wang, Jeremy Wohlwend, Tao Lei2020 · 196 citations
- Towards Faithful Model Explanation in NLP: A SurveyQing Lyu, Marianna Apidianaki, Chris Callison-Burch2024 · 194 citations
- Time-Aware Language Models as Temporal Knowledge BasesBhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, et al.2022 · 194 citations
- Supervised and Unsupervised Neural Approaches to Text ReadabilityMatej Martinc, Senja Pollak, Marko Robnik-Šikonja2021 · 190 citations
- Analyzing Uncertainty in Neural Machine TranslationMyle Ott, Michael Auli, David Grangier, et al.2018 · 190 citations
- PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning OptimizationYidong Wang, Zhuohao Yu, Zhengran Zeng, et al.2023 · 189 citations
- Findings of the 2021 Conference on Machine Translation (WMT21)Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, et al.2021 · 189 citations
- MuTual: A Dataset for Multi-Turn Dialogue ReasoningLeyang Cui, Yu Wu, Shujie Liu, et al.2020 · 189 citations
- On the Impact of Various Types of Noise on Neural Machine TranslationHuda Khayrallah, Philipp Koehn2018 · 188 citations
- SGPT: GPT Sentence Embeddings for Semantic SearchNiklas Muennighoff2022 · 187 citations
- Adaptive Machine Translation with Large Language ModelsYasmin Moslem, Rejwanul Haque, John D. Kelleher, et al.2023 · 186 citations
- Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 184 citations
- Investigating Backtranslation in Neural Machine TranslationAlberto Poncelas, Dimitar Shterionov, Andy Way, et al.2018 · 184 citations
- SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationSeamless Communication, Loic Barrault, Yu-An Chung, et al.2023 · 183 citations
- The Tatoeba Translation Challenge – Realistic Data Sets for Low Resource and Multilingual MTJörg Tiedemann2020 · 183 citations
- Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language ModelsYunfei Chu, Jin Xu, Xiaohuan Zhou, et al.2023 · 182 citations
- Mesh-TensorFlow: Deep Learning for SupercomputersNoam Shazeer, Youlong Cheng, Niki Parmar, et al.2018 · 182 citations
- Modeling Intra and Inter-modality Incongruity for Multi-Modal Sarcasm DetectionHongliang Pan, Zheng Lin, Peng Fu, et al.2020 · 181 citations
- Pre-training via ParaphrasingMike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.2020 · 181 citations
- Glancing Transformer for Non-Autoregressive Neural Machine TranslationLihua Qian, Hao Zhou, Yu Bao, et al.2021 · 180 citations
- Planning with Learned Entity Prompts for Abstractive SummarizationShashi Narayan, Yao Zhao, Joshua Maynez, et al.2021 · 180 citations
- Adapting Language Models to Compress ContextsAlexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 179 citations
- CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesThuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 179 citations
- Eliciting Latent Predictions from Transformers with the Tuned LensNora Belrose, Igor Ostrovsky, Lev McKinney, et al.2023 · 179 citations
- Charformer: Fast Character Transformers via Gradient-based Subword TokenizationYi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 179 citations
- Representation Degeneration Problem in Training Natural Language Generation ModelsJun Gao, Di He, Xu Tan, et al.2019 · 179 citations
- A neural interlingua for multilingual machine translationYichao Lu, Phillip Keung, Faisal Ladhak, et al.2018 · 178 citations
- Integrating Transformer and Paraphrase Rules for Sentence SimplificationSanqiang Zhao, Rui Meng, Daqing He, et al.2018 · 178 citations
- Findings of the IWSLT 2022 Evaluation CampaignAntonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, et al.2022 · 177 citations
- 8-bit Optimizers via Block-wise QuantizationTim Dettmers, Mike Lewis, Sam Shleifer, et al.2021 · 177 citations
- Pre-training Multilingual Neural Machine Translation by Leveraging Alignment InformationZehui Lin, Xiao Pan, Mingxuan Wang, et al.2020 · 177 citations
- AlphaEvolve: A coding agent for scientific and algorithmic discoveryAlexander Novikov, Ngân Vũ, Marvin Eisenberger, et al.2025 · 176 citations
- Coreference Resolution with Entity EqualizationBen Kantor, Amir Globerson2019 · 176 citations
- Translation Artifacts in Cross-lingual Transfer LearningMikel Artetxe, Gorka Labaka, Eneko Agirre2020 · 175 citations
- UNKs Everywhere: Adapting Multilingual Language Models to New ScriptsJonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2021 · 174 citations
- Investigating Multilingual NMT Representations at ScaleSneha Kudugunta, Ankur Bapna, Isaac Caswell, et al.2019 · 174 citations
- Tensor2Tensor for Neural Machine TranslationAshish Vaswani, Samy Bengio, Eugene Brevdo, et al.2018 · 174 citations
- Stance Detection in COVID-19 TweetsKyle Glandt, Sarthak Khanal, Yingjie Li, et al.2021 · 173 citations
- Lifting the Curse of Multilinguality by Pre-training Modular TransformersJonas Pfeiffer, Naman Goyal, Xi Victoria Lin, et al.2022 · 172 citations
- SemEval-2021 Task 5: Toxic Spans DetectionJohn Pavlopoulos, Jeffrey Sorensen, Léo Laugier, et al.2021 · 172 citations
- SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelLoubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 171 citations
- ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question AnsweringZhiyu Chen, Shiyang Li, Charese Smiley, et al.2022 · 171 citations
- KernelBench: Can LLMs Write Efficient GPU Kernels?Anne Ouyang, Simon Guo, Simran Arora, et al.2025 · 170 citations
- Do Llamas Work in English? On the Latent Language of Multilingual TransformersChris Wendler, Veniamin Veselovsky, Giovanni Monea, et al.2024 · 170 citations
- Learning to Compress Prompts with Gist TokensJesse Mu, Xiang Lisa Li, Noah Goodman2023 · 170 citations
- Neural Machine Translation Decoding with Terminology ConstraintsEva Hasler, Adrià de Gispert, Gonzalo Iglesias, et al.2018 · 170 citations
- AudioPaLM: A Large Language Model That Can Speak and ListenPaul K. Rubenstein, Chulayuth Asawaroengchai, Duc Dung Nguyen, et al.2023 · 169 citations
- AMR Parsing via Graph-Sequence Iterative InferenceDeng Cai, Wai Lam2020 · 168 citations
- ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectXin Men, Mingyu Xu, Qingyu Zhang, et al.2024 · 167 citations
- Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights CasesIlias Chalkidis, Manos Fergadiotis, Dimitrios Tsarapatsanis, et al.2021 · 167 citations
- Neural Syntactic Preordering for Controlled Paraphrase GenerationTanya Goyal, Greg Durrett2020 · 167 citations
- Deduplicating Training Data Mitigates Privacy Risks in Language ModelsNikhil Kandpal, Eric Wallace, Colin Raffel2022 · 166 citations
- On Generative Spoken Language Modeling from Raw AudioKushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, et al.2021 · 165 citations
- Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine TranslationBryan Eikema, Wilker Aziz2020 · 165 citations
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, et al.2025 · 164 citations
- SantaCoder: don't reach for the stars!Loubna Ben Allal, Raymond Li, Denis Kocetkov, et al.2023 · 164 citations
- Margin-based Parallel Corpus Mining with Multilingual Sentence EmbeddingsMikel Artetxe, Holger Schwenk2019 · 164 citations
- CogVideoX: Text-to-Video Diffusion Models with An Expert TransformerZhuoyi Yang, Jiayan Teng, Wendi Zheng, et al.2024 · 163 citations
- AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource LanguagesAbteen Ebrahimi, Manuel Mager, Arturo Oncevay, et al.2022 · 163 citations
- Tuning Multilingual Transformers for Language-Specific Named Entity RecognitionMikhail Arkhipov, Maria Trofimova, Yuri Kuratov, et al.2019 · 163 citations
- GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak PromptsJiahao Yu, Xingwei Lin, Zheng Yu, et al.2023 · 162 citations
- SCROLLS: Standardized CompaRison Over Long Language SequencesUri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 162 citations
- Explanations for CommonsenseQA: New Dataset and ModelsShourya Aggarwal, Divyanshu Mandowara, Vishwajeet Agrawal, et al.2021 · 162 citations
- EASSE: Easier Automatic Sentence Simplification EvaluationFernando Alva-Manchego, Louis Martin, Carolina Scarton, et al.2019 · 162 citations
- On Negative Interference in Multilingual Models: Findings and A Meta-Learning TreatmentZirui Wang, Zachary C. Lipton, Yulia Tsvetkov2020 · 161 citations
- Larger-Scale Transformers for Multilingual Masked Language ModelingNaman Goyal, Jingfei Du, Myle Ott, et al.2021 · 160 citations
- MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transferIlias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos2021 · 160 citations
- PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel ComputationWei Zeng, Xiaozhe Ren, Teng Su, et al.2021 · 159 citations
- The Linear Representation Hypothesis and the Geometry of Large Language ModelsKiho Park, Yo Joong Choe, Victor Veitch2023 · 157 citations
- DataComp-LM: In search of the next generation of training sets for language modelsJeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 156 citations
- VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksJing Yu Koh, Robert Lo, Lawrence Jang, et al.2024 · 156 citations
- Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationJonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 156 citations
- The (Un)Suitability of Automatic Evaluation Metrics for Text SimplificationFernando Alva-Manchego, Carolina Scarton, Lucia Specia2021 · 156 citations
- Unsupervised Translation of Programming LanguagesMarie-Anne Lachaux, Baptiste Roziere, Lowik Chanussot, et al.2020 · 156 citations
- LayerSkip: Enabling Early Exit Inference and Self-Speculative DecodingMostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, et al.2024 · 155 citations
- A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News TranslationDavid Ifeoluwa Adelani, Jesujoba Oluwadara Alabi, Angela Fan, et al.2022 · 155 citations
- On Hallucination and Predictive Uncertainty in Conditional Language GenerationYijun Xiao, William Yang Wang2021 · 155 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/cited-by/page/6/