Elamur Research⌕
☰
home / papers / mT5: A Massively Multilingual Pre-trained… / cited by

Who cites «mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer»

1,574 papers of our library cite it (of the 140,884 whose bibliographies we read) · 155 with a page here, the most cited first · page 1 of 2 · 1–100 · ← the paper

1 2

  1. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,375 citations
  2. On the Opportunities and Risks of Foundation ModelsRishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,044 citations
  3. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
  4. PaLM: Scaling Language Modeling with PathwaysAakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 2,603 citations
  5. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,695 citations
  6. Unifying Large Language Models and Knowledge Graphs: A RoadmapShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,545 citations
  7. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,316 citations
  8. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
  9. What Makes Good In-Context Examples for GPT-3?Jiachang Liu, Dinghan Shen, Yizhe Zhang, et al.2022 · 1,235 citations
  10. M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationJianlv Chen, Shitao Xiao, Peitian Zhang, et al.2024 · 1,196 citations
  11. PaLM 2 Technical ReportRohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 971 citations
  12. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 818 citations
  13. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 799 citations
  14. Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 692 citations
  15. Few-shot Learning with Multilingual Language ModelsXi Victoria Lin, Todor Mihaylov, Mikel Artetxe, et al.2021 · 496 citations
  16. Language Models are Multilingual Chain-of-Thought ReasonersFreda Shi, Mirac Suzgun, Markus Freitag, et al.2022 · 490 citations
  17. PPT: Pre-trained Prompt Tuning for Few-shot LearningYuxian Gu, Xu Han, Zhiyuan Liu, et al.2022 · 467 citations
  18. LLM-Pruner: On the Structural Pruning of Large Language ModelsXinyin Ma, Gongfan Fang, Xinchao Wang2023 · 447 citations
  19. Quality at a Glance: An Audit of Web-Crawled Multilingual DatasetsJulia Kreutzer, Isaac Caswell, Lisa Wang, et al.2021 · 447 citations
  20. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsPhillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 444 citations
  21. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  22. ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual LearningViet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, et al.2023 · 418 citations
  23. FLEURS: Few-shot Learning Evaluation of Universal Representations of SpeechAlexis Conneau, Min Ma, Simran Khanuja, et al.2022 · 398 citations
  24. Multilingual E5 Text Embeddings: A Technical ReportLiang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 343 citations
  25. PaLI: A Jointly-Scaled Multilingual Language-Image ModelXi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 339 citations
  26. UL2: Unifying Language Learning ParadigmsYi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 334 citations
  27. xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error DetectionNuno M. Guerreiro, Ricardo Rei, Daan van Stigt, et al.2024 · 333 citations
  28. Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic LanguagesGowtham Ramesh, Sumanth Doddapaneni, Aravinth Bheemaraj, et al.2022 · 307 citations
  29. Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
  30. Document-Level Machine Translation with Large Language ModelsLongyue Wang, Chenyang Lyu, Tianbo Ji, et al.2023 · 295 citations
  31. Prompting Large Language Model for Machine Translation: A Case StudyBiao Zhang, Barry Haddow, Alexandra Birch2023 · 293 citations
  32. Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, et al.2023 · 292 citations
  33. Challenges and Strategies in Cross-Cultural NLPDaniel Hershcovich, Stella Frank, Heather Lent, et al.2022 · 290 citations
  34. MEGA: Multilingual Evaluation of Generative AIKabir Ahuja, Harshita Diddee, Rishav Hada, et al.2023 · 281 citations
  35. XTREME-R: Towards More Challenging and Nuanced Multilingual EvaluationSebastian Ruder, Noah Constant, Jan Botha, et al.2021 · 277 citations
  36. Large Dual Encoders Are Generalizable RetrieversJianmo Ni, Chen Qu, Jing Lu, et al.2021 · 276 citations
  37. XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and BeyondFrancesco Barbieri, Luis Espinosa Anke, Jose Camacho-Collados2022 · 271 citations
  38. Having Beer after Prayer? Measuring Cultural Bias in Large Language ModelsTarek Naous, Michael J. Ryan, Alan Ritter, et al.2023 · 268 citations
  39. RedPajama: an Open Dataset for Training Large Language ModelsMaurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 247 citations
  40. Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelAhmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 245 citations
  41. mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalXin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 236 citations
  42. Tower: An Open Multilingual Large Language Model for Translation-Related TasksDuarte M. Alves, Jose Pombal, Nuno M. Guerreiro, et al.2024 · 226 citations
  43. MADLAD-400: A Multilingual And Document-Level Large Audited DatasetSneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 211 citations
  44. Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine TranslationHaoran Xu, Amr Sharaf, Yunmo Chen, et al.2024 · 207 citations
  45. mGPT: Few-Shot Learners Go MultilingualOleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
  46. Aya Dataset: An Open-Access Collection for Multilingual Instruction TuningShivalika Singh, Freddie Vargus, Daniel D'souza, et al.2024 · 202 citations
  47. AraT5: Text-to-Text Transformers for Arabic Language GenerationEl Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed2022 · 201 citations
  48. IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesJay Gala, Pranjal A. Chitale, Raghavan AK, et al.2023 · 200 citations
  49. SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)Shervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 190 citations
  50. Findings of the 2021 Conference on Machine Translation (WMT21)Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, et al.2021 · 189 citations
  51. CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesThuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 179 citations
  52. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationYi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 179 citations
  53. Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved YetTom Kocmi, Eleftherios Avramidis, Rachel Bawden, et al.2024 · 177 citations
  54. Evaluating Large Language Models: A Comprehensive SurveyZishan Guo, Renren Jin, Chuang Liu, et al.2023 · 177 citations
  55. Findings of the IWSLT 2022 Evaluation CampaignAntonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, et al.2022 · 177 citations
  56. Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesSumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, et al.2023 · 174 citations
  57. Aya 23: Open Weight Releases to Further Multilingual ProgressViraat Aryabumi, John Dang, Dwarak Talupuru, et al.2024 · 171 citations
  58. Do Llamas Work in English? On the Latent Language of Multilingual TransformersChris Wendler, Veniamin Veselovsky, Giovanni Monea, et al.2024 · 170 citations
  59. Larger-Scale Transformers for Multilingual Masked Language ModelingNaman Goyal, Jingfei Du, Myle Ott, et al.2021 · 160 citations
  60. MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transferIlias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos2021 · 160 citations
  61. DataComp-LM: In search of the next generation of training sets for language modelsJeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 156 citations
  62. The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation EvaluationPatrick Fernandes, Daniel Deutsch, Mara Finkelstein, et al.2023 · 156 citations
  63. Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationJonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 156 citations
  64. A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News TranslationDavid Ifeoluwa Adelani, Jesujoba Oluwadara Alabi, Angela Fan, et al.2022 · 155 citations
  65. Towards a Cleaner Document-Oriented Multilingual Crawled CorpusJulien Abadji, Pedro Ortiz Suarez, Laurent Romary, et al.2022 · 154 citations
  66. Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language ModelsTianyi Tang, Wenyang Luo, Haoyang Huang, et al.2024 · 151 citations
  67. Language Model Tokenizers Introduce Unfairness Between LanguagesAleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr, et al.2023 · 149 citations
  68. The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual DatasetHugo Laurençon, Lucile Saulnier, Thomas Wang, et al.2023 · 145 citations
  69. SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and DialectsDavid Ifeoluwa Adelani, Hannah Liu, Xiaoyu Shen, et al.2023 · 135 citations
  70. EuroLLM: Multilingual Language Models for EuropePedro Henrique Martins, Patrick Fernandes, Joao Alves, et al.2024 · 131 citations
  71. Learning Compact Metrics for MTAmy Pu, Hyung Won Chung, Ankur Parikh, et al.2021 · 130 citations
  72. LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal DomainJoel Niklaus, Veton Matoshi, Pooja Rani, et al.2023 · 122 citations
  73. MetricX-24: The Google Submission to the WMT 2024 Metrics Shared TaskJuraj Juraska, Daniel Deutsch, Mara Finkelstein, et al.2024 · 118 citations
  74. MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskJuraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.2023 · 118 citations
  75. GlotLID: Language Identification for Low-Resource LanguagesAmir Hossein Kargaran, Ayyoob Imani, François Yvon, et al.2023 · 115 citations
  76. ALLaM: Large Language Models for Arabic and EnglishM Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
  77. DistiLLM: Towards Streamlined Distillation for Large Language ModelsJongwoo Ko, Sungnyun Kim, Tianyi Chen, et al.2024 · 111 citations
  78. WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language modelsBenjamin Minixhofer, Fabian Paischer, Navid Rekabsaz2022 · 90 citations
  79. Coreference Resolution through a seq2seq Transition-Based SystemBernd Bohnet, Chris Alberti, Michael Collins2023 · 77 citations
  80. Multi-VALUE: A Framework for Cross-Dialectal English NLPCaleb Ziems, William Held, Jingfeng Yang, et al.2023 · 73 citations
  81. Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form TextsEleftheria Briakou, Jiaming Luo, Colin Cherry, et al.2024 · 46 citations
  82. FRMT: A Benchmark for Few-Shot Region-Aware Machine TranslationParker Riley, Timothy Dozat, Jan A. Botha, et al.2023 · 33 citations
  83. Chinese Idiom ParaphrasingJipeng Qiang, Yang Li, Chaowei Zhang, et al.2023 · 31 citations
  84. Findings of the Second Shared Task on Multilingual Coreference ResolutionZdeněk Žabokrtský, Miloslav Konopik, Anna Nedoluzhko, et al.2023 · 27 citations
  85. An Expanded Massive Multilingual Dataset for High-Performance Language Technologies (HPLT)Laurie Burchell, Ona de Gibert, Nikolay Arefyev, et al.2025 · 23 citations
  86. DictaBERT: A State-of-the-Art BERT Suite for Modern HebrewShaltiel Shmidman, Avi Shmidman, Moshe Koppel2023 · 22 citations
  87. CAW-coref: Conjunction-Aware Word-level Coreference ResolutionKarel D'Oosterlinck, Semere Kiros Bitew, Brandon Papineau, et al.2023 · 17 citations
  88. ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference ResolutionMilan Straka2023 · 17 citations
  89. Bridging Cultural Nuances in Dialogue Agents through Cultural Value SurveysYong Cao, Min Chen, Daniel Hershcovich2024 · 16 citations
  90. Beyond Correlation: Interpretable Evaluation of Machine Translation MetricsStefano Perrella, Lorenzo Proietti, Pere-Lluís Huguet Cabot, et al.2024 · 15 citations
  91. HeRo: RoBERTa and Longformer Hebrew Language ModelsVitaly Shalumov, Harel Haskey2023 · 15 citations
  92. SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?Senyu Li, Jiayi Wang, Felermino D. M. A. Ali, et al.2025 · 13 citations
  93. Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling PerspectiveIan Porada, Alexandra Olteanu, Kaheer Suleman, et al.2024 · 10 citations
  94. Towards Arabic Sentence Simplification via Classification and Generative ApproachesNouran Khallaf, Serge Sharoff, Rasha Soliman2022 · 10 citations
  95. Multilingual Sequence-to-Sequence Models for Hebrew NLPMatan Eyal, Hila Noga, Roee Aharoni, et al.2023 · 9 citations
  96. Assessing the Role of Context in Chat Translation Evaluation: Is Context Helpful and Under What Conditions?Sweta Agrawal, Amin Farajian, Patrick Fernandes, et al.2024 · 8 citations
  97. [Lions: 1] and [Tigers: 2] and [Bears: 3], Oh My! Literary Coreference Annotation with LLMsRebecca Hicke, David Mimno2024 · 7 citations
  98. A Controlled Reevaluation of Coreference Resolution ModelsIan Porada, Xiyuan Zou, Jackie Chi Kit Cheung2024 · 7 citations
  99. HeSum: a Novel Dataset for Abstractive Text Summarization in HebrewTzuf Paz-Argaman, Itai Mondshine, Asaf Achi Mordechai, et al.2024 · 7 citations
  100. Explicit Morphological Knowledge Improves Pre-training of Language Models for HebrewEylon Gueta, Omer Goldman, Reut Tsarfaty2023 · 7 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/xue-2021-mt5-massively-multilingual-pre-trained/cited-by/