Who cites Wietse de Vries
- Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,753 citationsRecent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,552 citations
- AraBERT: Transformer-based Model for Arabic Language UnderstandingarXiv:2003.00104Wissam Antoun, Fady Baly, Hazem Hajj2020 · 1,302 citationsPhoBERT: Pre-trained language models for VietnameseFindings of the Association for Computational LinguisticsDat Quoc Nguyen, Anh Tuan Nguyen2020 · 571 citations
- ARBERT & MARBERT: Deep Bidirectional Transformers for ArabicarXiv:2101.01785 · ACL-2021 camera ready versionMuhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi2021 · 478 citationsHow Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Phillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 444 citations
- RobBERT: a Dutch RoBERTa-based Language ModelarXiv:2001.06286Pieter Delobelle, Thomas Winters, Bettina Berendt2020 · 348 citations
- FlauBERT: Unsupervised Language Model Pre-training for FrencharXiv:1912.05372Hang Le, Loïc Vial, Jibril Frej, et al.2019 · 297 citationsWhen Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Benjamin Muller, Antonios Anastasopoulos, Benoît Sagot, et al.2021 · 189 citations
- Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingMinh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, et al.2021 · 169 citations
- Pre-Training BERT on Arabic Tweets: Practical ConsiderationsarXiv:2102.10684Ahmed Abdelali, Sabit Hassan, Hamdy Mubarak, et al.2021 · 150 citationsLEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal DomainFindings of the Association for Computational LinguisticsJoel Niklaus, Veton Matoshi, Pooja Rani, et al.2023 · 123 citationsRevisiting the Uniform Information Density HypothesisConference on Empirical Methods in Natural Language Processing (EMNLP)Clara Meister, Tiago Pimentel, Patrick Haller, et al.2021 · 123 citations
- FineWeb2: One Pipeline to Scale Them All — Adapting Pre-Training Data Processing to Every LanguagearXiv:2506.20920Guilherme Penedo, Hynek Kydliček, Vinko Sabolčec, et al.2025 · 97 citationsAs Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other LanguagesFindings of the Association for Computational LinguisticsWietse de Vries, Malvina Nissim2021 · 91 citationsWECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language modelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Benjamin Minixhofer, Fabian Paischer, Navid Rekabsaz2022 · 90 citationsFOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Konstantin Dobler, Gerard de Melo2023 · 61 citationsA Benchmark of Rule-Based and Neural Coreference Resolution in Dutch Novels and NewsWorkshop on Computational Models of Reference, Anaphora and Coreference (CRAC)Corbèn Poot, Andreas van Cranenburgh2020 · 21 citations
- Hybrid Enhanced Universal Dependencies ParsingJohannes Heinecke2020 · 20 citations
- On the Importance of Tokenization in Arabic Embedding ModelsMohamed Alkaoud, Mairaj Syed2020 · 11 citationsThe ADAPT Enhanced Dependency Parser at the IWPT 2020 Shared TaskInternational Conference on Parsing Technologies and the IWPT Shared Task on Parsing into Enhanced Universal DependenciesJames Barry, Joachim Wagner, Jennifer Foster2020 · 9 citations
- Transferring Monolingual Model to Low-Resource Language: The Case of TigrinyaarXiv:2006.07698Abrhalei Tela; Abraham Woubie;, Ville Hautamaki2020 · 9 citations
- Bilingual Adaptation of Monolingual Foundation ModelsarXiv:2407.12869Gurpreet Gosal, Yishi Xu, Gokul Ramakrishnan, et al.2024 · 7 citationsA Corpus of Joint EEG and Self-Paced Reading of Natural Dutch TextsLanguage Resources and Evaluation Conference (LREC)Sara Møller Østergaard, Lenneke Doris Lichtenberg, Laura Boon, et al.2026 · 1 citation
- AlcLaM: Arabic Dialectal Language ModelarXiv:2407.13097Murtadha Ahmed, Saghir Alfasly, Bo Wen, et al.2024 · 1 citationAutomatic Prediction of Prominence and Boundary Strength from TextLanguage Resources and Evaluation Conference (LREC)Pauline Mas, Kévin Vythelingum, Jonathan Chevelu, et al.2026LGSE: Lexically Grounded Subword Embedding Initialization for Low-Resource Language AdaptationLanguage Resources and Evaluation Conference (LREC)Hailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2026
mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Linting Xue, Noah Constant, Adam Roberts, et al.2021 · 3,197 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/wietse-de-vries/cited-by/