🔗 Who cites «Cloze-driven Pretraining of Self-attention Networks»

74 papers of our library cite it (of the 149,439 whose bibliographies we read) · 13 with a page here, the most cited first · ← back to «Cloze-driven Pretraining of Self-attention Networks»

1. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
2. RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
3. Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
4. Multitask Prompted Training Enables Zero-Shot Task GeneralizationarXiv:2110.08207Victor Sanh, Albert Webson, Colin Raffel, et al.2021 · 1,612 citations
5. Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197Li Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,422 citations
6. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleInterspeechArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 807 citations
7. CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataLanguage Resources and Evaluation Conference (LREC)Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.2020 · 666 citations
8. Are All Languages Created Equal in Multilingual BERT?Workshop on Representation Learning for NLPShijie Wu, Mark Dredze2020 · 460 citations
9. Visualizing and Understanding the Effectiveness of BERTConference on Empirical Methods in Natural Language Processing (EMNLP)Yaru Hao, Li Dong, Furu Wei, et al.2019 · 222 citations
10. Automated Concatenation of Embeddings for Structured PredictionAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Wang, Yong Jiang, Nguyen Bach, et al.2021 · 206 citations
11. Improving Named Entity Recognition by External Context Retrieving and Cooperative LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Wang, Yong Jiang, Nguyen Bach, et al.2021 · 206 citations
12. NeoBERT: A Next-Generation BERTarXiv:2502.19587Lola Le Breton, Quentin Fournier, Mariam El Mezouar, et al.2025 · 20 citations
13. DeformAr: Rethinking NER Evaluation through Component Analysis and Visual AnalyticsarXiv:2512.00938Ahmed Mustafa Younes2025

61 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/baevski-2019-cloze-driven-pretraining-self-attention/cited-by/