Elamur Research⌕
☰
home / authors / Pedro Ortiz Suarez / cited by

Who cites Pedro Ortiz Suarez

1,274 citations of their works from 1,124 papers of our library (of the 140,884 whose bibliographies we read) · 126 with a page here, the most cited first · page 1 of 2 · 1–100 · ← Pedro Ortiz Suarez

1 2

  1. On the Opportunities and Risks of Foundation ModelsRishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,044 citations
  2. Pre-trained Models for Natural Language Processing: A SurveyXipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,740 citations
  3. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,695 citations
  4. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLinting Xue, Noah Constant, Adam Roberts, et al.2021 · 1,574 citations
  5. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,548 citations
  6. AraBERT: Transformer-based Model for Arabic Language UnderstandingWissam Antoun, Fady Baly, Hazem Hajj2020 · 1,297 citations
  7. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 992 citations
  8. PaLM 2 Technical ReportRohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 971 citations
  9. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 818 citations
  10. PhoBERT: Pre-trained language models for VietnameseDat Quoc Nguyen, Anh Tuan Nguyen2020 · 571 citations
  11. ARBERT & MARBERT: Deep Bidirectional Transformers for ArabicMuhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi2021 · 478 citations
  12. Quality at a Glance: An Audit of Web-Crawled Multilingual DatasetsJulia Kreutzer, Isaac Caswell, Lisa Wang, et al.2021 · 447 citations
  13. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsPhillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 444 citations
  14. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  15. Ethical and social risks of harm from Language ModelsLaura Weidinger, John Mellor, Maribeth Rauh, et al.2021 · 421 citations
  16. KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social MediaAli Safaya, Moutasem Abdullatif, Deniz Yuret2020 · 409 citations
  17. The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleGuilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 404 citations
  18. German's Next Language ModelBranden Chan, Stefan Schweter, Timo Möller2020 · 385 citations
  19. The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language ModelsGo Inoue, Bashar Alhafni, Nurpeiis Baimukan, et al.2021 · 365 citations
  20. Datasets: A Community Library for Natural Language ProcessingQuentin Lhoest, Albert Villanova del Moral, Yacine Jernite, et al.2021 · 358 citations
  21. Large Language Models Struggle to Learn Long-Tail KnowledgeNikhil Kandpal, Haikang Deng, Adam Roberts, et al.2022 · 352 citations
  22. RobBERT: a Dutch RoBERTa-based Language ModelPieter Delobelle, Thomas Winters, Bettina Berendt2020 · 346 citations
  23. Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic LanguagesGowtham Ramesh, Sumanth Doddapaneni, Aravinth Bheemaraj, et al.2022 · 307 citations
  24. Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
  25. BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in BanglaAbhik Bhattacharjee, Tahmid Hasan, Wasi Ahmad, et al.2022 · 296 citations
  26. IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language UnderstandingBryan Wilie, Karissa Vincentio, Genta Indra Winata, et al.2020 · 265 citations
  27. The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsLucas Bandarkar, Davis Liang, Benjamin Muller, et al.2023 · 259 citations
  28. Multilingual is not enough: BERT for FinnishAntti Virtanen, Jenna Kanerva, Rami Ilo, et al.2019 · 256 citations
  29. Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelAhmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 245 citations
  30. NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each BenchmarkOscar Sainz, Jon Campos, Iker García-Ferrero, et al.2023 · 245 citations
  31. In-context Examples Selection for Machine TranslationSweta Agrawal, Chunting Zhou, Mike Lewis, et al.2023 · 241 citations
  32. A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource LanguagesPedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot2020 · 219 citations
  33. MADLAD-400: A Multilingual And Document-Level Large Audited DatasetSneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 211 citations
  34. mGPT: Few-Shot Learners Go MultilingualOleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
  35. Aya Dataset: An Open-Access Collection for Multilingual Instruction TuningShivalika Singh, Freddie Vargus, Daniel D'souza, et al.2024 · 202 citations
  36. AraT5: Text-to-Text Transformers for Arabic Language GenerationEl Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed2022 · 201 citations
  37. IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesJay Gala, Pranjal A. Chitale, Raghavan AK, et al.2023 · 200 citations
  38. What matters when building vision-language models?Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 195 citations
  39. HONEST: Measuring Hurtful Sentence Completion in Language ModelsDebora Nozza, Federico Bianchi, Dirk Hovy2021 · 190 citations
  40. When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language ModelsBenjamin Muller, Antonios Anastasopoulos, Benoît Sagot, et al.2021 · 189 citations
  41. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsHugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 183 citations
  42. Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual EvaluationShivalika Singh, Angelika Romanou, Clémentine Fourrier, et al.2025 · 179 citations
  43. CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesThuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 179 citations
  44. Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesSumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, et al.2023 · 174 citations
  45. Do All Languages Cost the Same? Tokenization in the Era of Commercial Language ModelsOrevaoghene Ahia, Sachin Kumar, Hila Gonen, et al.2023 · 164 citations
  46. MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transferIlias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos2021 · 160 citations
  47. DataComp-LM: In search of the next generation of training sets for language modelsJeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 156 citations
  48. A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News TranslationDavid Ifeoluwa Adelani, Jesujoba Oluwadara Alabi, Angela Fan, et al.2022 · 155 citations
  49. Towards a Cleaner Document-Oriented Multilingual Crawled CorpusJulien Abadji, Pedro Ortiz Suarez, Laurent Romary, et al.2022 · 154 citations
  50. ChatGPT MT: Competitive for High- (but Not Low-) Resource LanguagesNathaniel Robinson, Perez Ogayo, David R. Mortensen, et al.2023 · 151 citations
  51. Pre-Training BERT on Arabic Tweets: Practical ConsiderationsAhmed Abdelali, Sabit Hassan, Hamdy Mubarak, et al.2021 · 150 citations
  52. Language Model Tokenizers Introduce Unfairness Between LanguagesAleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr, et al.2023 · 149 citations
  53. Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine TranslationNuno M. Guerreiro, Elena Voita, André Martins2023 · 147 citations
  54. The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual DatasetHugo Laurençon, Lucile Saulnier, Thomas Wang, et al.2023 · 145 citations
  55. Extracting Latent Steering Vectors from Pretrained Language ModelsNishant Subramani, Nivedita Suresh, Matthew Peters2022 · 131 citations
  56. Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction BenchmarkJoel Niklaus, Ilias Chalkidis, Matthias Stürmer2021 · 129 citations
  57. LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal DomainJoel Niklaus, Veton Matoshi, Pooja Rani, et al.2023 · 122 citations
  58. GlotLID: Language Identification for Low-Resource LanguagesAmir Hossein Kargaran, Ayyoob Imani, François Yvon, et al.2023 · 115 citations
  59. Playing with Words at the National Library of Sweden — Making a Swedish BERTMartin Malmsten, Love Borjeson, Chris Haffenden2020 · 105 citations
  60. Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex WordsValentin, Hofmann2021 · 101 citations
  61. WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language modelsBenjamin Minixhofer, Fabian Paischer, Navid Rekabsaz2022 · 90 citations
  62. HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion RecognitionAvihay Chriqui, Inbal Yahav2021 · 68 citations
  63. Tokenization Is More Than CompressionCraig W Schmidt, Varshini Reddy, Haoran Zhang, et al.2024 · 66 citations
  64. An Open Dataset and Model for Language IdentificationLaurie Burchell, Alexandra Birch, Nikolay Bogoychev, et al.2023 · 59 citations
  65. AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence LevelAmit Seker, Elron Bandel, Dan Bareket, et al.2022 · 57 citations
  66. AlephBERT: A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application WithAmit Seker, Elron Bandel, Dan Bareket, et al.2021 · 56 citations
  67. DziriBERT: a Pre-trained Language Model for the Algerian DialectAmine Abdaoui, Mohamed Berrimi, Mourad Oussalah, et al.2021 · 38 citations
  68. TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse LanguagesAnirudh Srinivasan, Eunsol Choi2022 · 29 citations
  69. Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African ArabiziBenjamin Muller, Benoit Sagot, Djame Seddah2020 · 26 citations
  70. An Expanded Massive Multilingual Dataset for High-Performance Language Technologies (HPLT)Laurie Burchell, Ona de Gibert, Nikolay Arefyev, et al.2025 · 23 citations
  71. A Survey of Corpora for Germanic Low-Resource Languages and DialectsVerena Blaschke, Hinrich Schuetze, Barbara Plank2023 · 22 citations
  72. Multilingual Irony Detection with Dependency Syntax and Neural ModelsAlessandra Teresa Cignarella, Valerio Basile, Manuela Sanguinetti, et al.2020 · 21 citations
  73. Hybrid Enhanced Universal Dependencies ParsingJohannes Heinecke2020 · 20 citations
  74. A Large and Diverse Arabic Corpus for Language ModelingAbbas Raza Ali, Muhammad Ajmal Siddiqui, Rema Algunaibet, et al.2022 · 16 citations
  75. JABER and SABER: Junior and Senior Arabic BERtAbbas Ghaddar, Yimeng Wu, Ahmad Rashid, et al.2021 · 16 citations
  76. HeRo: RoBERTa and Longformer Hebrew Language ModelsVitaly Shalumov, Harel Haskey2023 · 15 citations
  77. Alignment at Pre-training! Towards Native Alignment for Arabic LLMsJuhao Liang, Zhenyang Cai, Jianqing Zhu, et al.2024 · 14 citations
  78. ÚFAL CorPipe at CRAC 2022: Effectivity of Multilingual Models for Coreference ResolutionMilan Straka, Jana Straková2022 · 12 citations
  79. ParaShoot: A Hebrew Question Answering DatasetOmri Keren, Omer Levy2021 · 12 citations
  80. Neural Coreference Resolution for ArabicAbdulrahman Aloraini, Juntao Yu, Massimo Poesio2020 · 12 citations
  81. Multilingual Coreference Resolution in Multiparty DialogueBoyuan Zheng, Patrick Xia, Mahsa Yarmohammadi, et al.2023 · 11 citations
  82. On the Importance of Tokenization in Arabic Embedding ModelsMohamed Alkaoud, Mairaj Syed2020 · 11 citations
  83. Transformer-based Hebrew NLP models for Short Answer Scoring in BiologyAbigail Gurin Schleifer, Beata Beigman Klebanov, Moriah Ariely, et al.2023 · 10 citations
  84. Multilingual Sequence-to-Sequence Models for Hebrew NLPMatan Eyal, Hila Noga, Roee Aharoni, et al.2023 · 9 citations
  85. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language UnderstandingAbbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 9 citations
  86. The ADAPT Enhanced Dependency Parser at the IWPT 2020 Shared TaskJames Barry, Joachim Wagner, Jennifer Foster2020 · 9 citations
  87. SemEval-2022 Task 3: PreTENS — Evaluating Neural Networks on Presuppositional Semantic KnowledgeRoberto Zamparelli, Shammur Chowdhury, Dominique Brunato, et al.2022 · 8 citations
  88. TArC: Tunisian Arabish Corpus, First complete releaseElisa Gugliotta, Marco Dinarelli2022 · 8 citations
  89. Beyond Random Sampling: Efficient Language Model Pretraining via Curriculum LearningYang Zhang, Amr Mohamed, Hadi Abdine, et al.2026 · 7 citations
  90. Arabic Stable LM: Adapting Stable LM 2 1.6B to ArabicZaid Alyafeai, Michael Pieler, Hannah Teufel, et al.2024 · 6 citations
  91. Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language ModelsMohamed Taher Alrefaie, Nour Eldin Morsy, Nada Samir2024 · 5 citations
  92. Kuwain 1.5B: An Arabic SLM via Language InjectionKhalil Hennara, Sara Chrouf, Mohamed Motaism Hamed, et al.2025 · 4 citations
  93. MoVoC: Morphology-Aware Subword Construction for Ge'ez Script LanguagesHailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2025 · 4 citations
  94. MoVoC: Morphology-Aware Subword Construction for Geez Script LanguagesHailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2025 · 4 citations
  95. MultiCoPIE: A Multilingual Corpus of Potentially Idiomatic Expressions for Cross-lingual PIE DisambiguationUliana Sentsova, Debora Ciminari, Josef van Genabith, et al.2025 · 4 citations
  96. Do Diacritics Matter? Evaluating the Impact of Arabic Diacritics on Tokenization and LLM BenchmarksGo Inoue, Bashar Alhafni, Nizar Habash, et al.2026 · 3 citations
  97. Towards the Development of Balanced Synthetic Data for Correcting Grammatical Errors in Arabic: An Approach Based on Error Tagging Model and Synthetic Data Generating ModelAhlam Alrehili, Areej Alhothali2025 · 3 citations
  98. Evaluating large language models for the tasks of PoS tagging within the Universal Dependency frameworkMateus Machado, Evandro Ruiz2024 · 3 citations
  99. Out-of-Domain Dependency Parsing for Dialects of Arabic: A Case StudyNoor Abo Mokh, Daniel Dakota, Sandra Kübler2024 · 3 citations
  100. Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered LensHellina Hailu Nigatu, Bethelhem Yemane Mamo, Bontu Fufa Balcha, et al.2026 · 1 citation

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/pedro-ortiz-suarez/cited-by/