Who cites «Unsupervised Cross-lingual Representation Learning at Scale»

4,133 papers of our library cite it (of the 149,439 whose bibliographies we read) · 689 with a page here, the most cited first · page 1 of 7 · 1–100 · ← back to «Unsupervised Cross-lingual Representation Learning at Scale»

Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing SurveysPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,423 citations
mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Linting Xue, Noah Constant, Adam Roberts, et al.2021 · 3,226 citations
Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language InferenceConference of the European Chapter of the Association for Computational Linguistics (EACL)Timo Schick, Hinrich Schütze2021 · 1,817 citations
COMET: A Neural Framework for MT EvaluationRicardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 1,792 citations
Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,556 citations
Language-agnostic BERT Sentence EmbeddingAnnual Meeting of the Association for Computational Linguistics (ACL)Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.2020 · 1,413 citations
Making Monolingual Sentence Embeddings Multilingual using Knowledge DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Nils Reimers, Iryna Gurevych2020 · 1,322 citations
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingarXiv:2111.09543Pengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,320 citations
AraBERT: Transformer-based Model for Arabic Language UnderstandingarXiv:2003.00104Wissam Antoun, Fady Baly, Hazem Hajj2020 · 1,304 citations
CamemBERT: a Tasty French Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,269 citations
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationarXiv:2402.03216Jianlv Chen, Shitao Xiao, Peitian Zhang, et al.2024 · 1,196 citations
BERTweet: A pre-trained language model for English TweetsConference on Empirical Methods in Natural Language Processing (EMNLP)Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen2020 · 1,144 citations
Bias and Fairness in Large Language Models: A SurveyComputational LinguisticsIsabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.2023 · 1,082 citations
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 839 citations
Unsupervised Dense Information Retrieval with Contrastive LearningarXiv:2112.09118Gautier Izacard, Mathilde Caron, Lucas Hosseini, et al.2021 · 836 citations
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleInterspeechArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 807 citations
LayoutLMv3: Pre-training for Document AI with Unified Text and Image MaskingACM International Conference on Multimedia (ACM MM)Yupan Huang, Tengchao Lv, Lei Cui, et al.2022 · 778 citations
Unified Pre-training for Program Understanding and GenerationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Wasi Ahmad, Saikat Chakraborty, Baishakhi Ray, et al.2021 · 750 citations
IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian LanguagesFindings of the Association for Computational LinguisticsDivyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.2020 · 732 citations
Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
PhoBERT: Pre-trained language models for VietnameseFindings of the Association for Computational LinguisticsDat Quoc Nguyen, Anh Tuan Nguyen2020 · 571 citations
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual GeneralizationarXiv:2003.11080Junjie Hu, Sebastian Ruder, Aditya Siddhant, et al.2020 · 558 citations
Precise Zero-Shot Dense Retrieval without Relevance LabelsAnnual Meeting of the Association for Computational Linguistics (ACL)Luyu Gao, Xueguang Ma, Jimmy Lin, et al.2022 · 549 citations
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Armen Aghajanyan, Sonal Gupta, Luke Zettlemoyer2021 · 542 citations
Few-shot Learning with Multilingual Language ModelsarXiv:2112.10668Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, et al.2021 · 500 citations
Language Models are Multilingual Chain-of-Thought ReasonersarXiv:2210.03057Freda Shi, Mirac Suzgun, Markus Freitag, et al.2022 · 494 citations
ARBERT & MARBERT: Deep Bidirectional Transformers for ArabicarXiv:2101.01785 · ACL-2021 camera ready versionMuhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi2021 · 478 citations
XCOPA: A Multilingual Dataset for Causal Commonsense ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Edoardo Maria Ponti, Goran Glavaš, Olga Majewska, et al.2020 · 469 citations
From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Anne Lauscher, Vinit Ravishankar, Ivan Vulić, et al.2020 · 463 citations
Are All Languages Created Equal in Multilingual BERT?Workshop on Representation Learning for NLPShijie Wu, Mark Dredze2020 · 460 citations
Quality at a Glance: An Audit of Web-Crawled Multilingual DatasetsTransactions of the Association for Computational Linguistics (TACL)Julia Kreutzer, Isaac Caswell, Lisa Wang, et al.2021 · 454 citations
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Phillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 449 citations
The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
Improving Text Embeddings with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Liang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 437 citations
The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleConference on Neural Information Processing Systems (NeurIPS)Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 434 citations
ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual LearningFindings of the Association for Computational LinguisticsViet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, et al.2023 · 422 citations
MuRIL: Multilingual Representations for Indian LanguagesarXiv:2103.10730Simran Khanuja, Diksha Bansal, Sarvesh Mehtani, et al.2021 · 408 citations
A Survey on Recent Approaches for Natural Language Processing in Low-Resource ScenariosConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Michael A. Hedderich, Lukas Lange, Heike Adel, et al.2021 · 401 citations
German's Next Language ModelInternational Conference on Computational Linguistics (COLING)Branden Chan, Stefan Schweter, Timo Möller2020 · 385 citations
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Yaobo Liang, Nan Duan, Yeyun Gong, et al.2020 · 358 citations
SemEval-2020 Task 1: Unsupervised Lexical Semantic Change DetectionInternational Workshop on Semantic Evaluation (SemEval)Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, et al.2020 · 351 citations
Multilingual E5 Text Embeddings: A Technical ReportarXiv:2402.05672Liang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 346 citations
Scaling Speech Technology to 1,000+ LanguagesarXiv:2305.13516Vineel Pratap, Andros Tjandra, Bowen Shi, et al.2023 · 334 citations
Unsupervised Domain Clusters in Pretrained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Roee Aharoni, Yoav Goldberg2020 · 330 citations
CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared TaskConference on Machine Translation (WMT)Ricardo Rei, Marcos Treviso, Nuno M. Guerreiro, et al.2022 · 325 citations
Probing Pretrained Language Models for Lexical SemanticsConference on Empirical Methods in Natural Language Processing (EMNLP)Ivan Vulić, Edoardo Maria Ponti, Robert Litschko, et al.2020 · 320 citations
Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationTransactions of the Association for Computational Linguistics (TACL)Jonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 301 citations
FlauBERT: Unsupervised Language Model Pre-training for FrencharXiv:1912.05372Hang Le, Loïc Vial, Jibril Frej, et al.2019 · 299 citations
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in BanglaFindings of the Association for Computational LinguisticsAbhik Bhattacharjee, Tahmid Hasan, Wasi Ahmad, et al.2022 · 296 citations
MEGA: Multilingual Evaluation of Generative AIarXiv:2303.12528Kabir Ahuja, Harshita Diddee, Rishav Hada, et al.2023 · 285 citations
XTREME-R: Towards More Challenging and Nuanced Multilingual EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Sebastian Ruder, Noah Constant, Jan Botha, et al.2021 · 281 citations
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingarXiv:2007.07834Zewen Chi, Li Dong, Furu Wei, et al.2020 · 275 citations
Having Beer after Prayer? Measuring Cultural Bias in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Tarek Naous, Michael J. Ryan, Alan Ritter, et al.2023 · 272 citations
XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and BeyondLanguage Resources and Evaluation Conference (LREC)Francesco Barbieri, Luis Espinosa Anke, Jose Camacho-Collados2022 · 271 citations
IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language UnderstandingConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Bryan Wilie, Karissa Vincentio, Genta Indra Winata, et al.2020 · 266 citations
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsAnnual Meeting of the Association for Computational Linguistics (ACL)Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.2023 · 262 citations
Fairseq S2T: Fast Speech-to-Text Modeling with FairseqConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Changhan Wang, Yun Tang, Xutai Ma, et al.2020 · 259 citations
The Multilingual Amazon Reviews CorpusConference on Empirical Methods in Natural Language Processing (EMNLP)Phillip Keung, Yichao Lu, György Szarvas, et al.2020 · 257 citations
Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelarXiv:2402.07827Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 253 citations
MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing BenchmarkConference of the European Chapter of the Association for Computational Linguistics (EACL)Haoran Li, Abhinav Arora, Shuohui Chen, et al.2021 · 242 citations
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagearXiv:2208.03188Kurt Shuster, Jing Xu, Mojtaba Komeili, et al.2022 · 241 citations
Pretrained Language Models for Biomedical and Clinical Tasks: Understanding and Extending the State-of-the-ArtWorkshop on Clinical Natural Language Processing (Clinical NLP) @ LRECPatrick Lewis, Myle Ott, Jingfei Du, et al.2020 · 241 citations
SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed TweetsInternational Workshop on Semantic Evaluation (SemEval)Parth Patwa, Gustavo Aguilar, Sudipta Kar, et al.2020 · 240 citations
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Xin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 237 citations
Detecting Hallucinated Content in Conditional Neural Sequence GenerationFindings of the Association for Computational LinguisticsChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 232 citations
DataComp: In search of the next generation of multimodal datasetsConference on Neural Information Processing Systems (NeurIPS)Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, et al.2023 · 224 citations
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingarXiv:2305.07004Haoyang Huang, Tianyi Tang, Dongdong Zhang, et al.2023 · 224 citations
Multilingual Translation from Denoising Pre-TrainingFindings of the Association for Computational LinguisticsYuqing Tang, Chau Tran, Xian Li, et al.2021 · 220 citations
Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsarXiv:2308.16149Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 218 citations
MADLAD-400: A Multilingual And Document-Level Large Audited DatasetConference on Neural Information Processing Systems (NeurIPS)Sneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 213 citations
Multilingual Offensive Language Identification with Cross-lingual EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP)Tharindu Ranasinghe, Marcos Zampieri2020 · 211 citations
Language Model Tokenizers Introduce Unfairness Between LanguagesConference on Neural Information Processing Systems (NeurIPS)Aleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr, et al.2023 · 206 citations
Automated Concatenation of Embeddings for Structured PredictionAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Wang, Yong Jiang, Nguyen Bach, et al.2021 · 206 citations
Improving Named Entity Recognition by External Context Retrieving and Cooperative LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Wang, Yong Jiang, Nguyen Bach, et al.2021 · 206 citations
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model AdaptationAnnual Meeting of the Association for Computational Linguistics (ACL)Ruidan He, Linlin Liu, Hai Ye, et al.2021 · 204 citations
mGPT: Few-Shot Learners Go MultilingualarXiv:2204.07580Oleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
Large Language Model as Attributed Training Data Generator: A Tale of Diversity and BiasConference on Neural Information Processing Systems (NeurIPS)Yue Yu, Yuchen Zhuang, Jieyu Zhang, et al.2023 · 202 citations
AraT5: Text-to-Text Transformers for Arabic Language GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)El Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed2022 · 201 citations
IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesarXiv:2305.16307Jay Gala, Pranjal A. Chitale, Raghavan AK, et al.2023 · 200 citations
Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-TuningInternational Conference on Computational Linguistics (COLING)Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, et al.2022 · 195 citations
End-to-End Slot Alignment and Recognition for Cross-Lingual NLUConference on Empirical Methods in Natural Language Processing (EMNLP)Weijia Xu, Batool Haider, Saab Mansour2020 · 194 citations
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLParXiv:2112.10508Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky, et al.2021 · 191 citations
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Benjamin Muller, Antonios Anastasopoulos, Benoît Sagot, et al.2021 · 191 citations
SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)International Workshop on Semantic Evaluation (SemEval)Shervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 190 citations
GLiNER: Generalist Model for Named Entity Recognition using Bidirectional TransformerConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Urchade Zaratiana, Nadi Tomeh, Pierre Holat, et al.2024 · 189 citations
Pre-training via ParaphrasingarXiv:2006.15020Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.2020 · 187 citations
Charformer: Fast Character Transformers via Gradient-based Subword TokenizationarXiv:2106.12672Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 186 citations
CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesLanguage Resources and Evaluation Conference (LREC)Thuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 181 citations
MultiCoNER: A Large-scale Multilingual Dataset for Complex Named Entity RecognitionInternational Conference on Computational Linguistics (COLING)Shervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 181 citations
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Nora Kassner, Philipp Dufter, Hinrich Schütze2021 · 180 citations
Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved YetConference on Machine Translation (WMT)Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, et al.2024 · 178 citations
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment InformationConference on Empirical Methods in Natural Language Processing (EMNLP)Zehui Lin, Xiao Pan, Mingxuan Wang, et al.2020 · 178 citations
Do Llamas Work in English? On the Latent Language of Multilingual TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Chris Wendler, Veniamin Veselovsky, Giovanni Monea, et al.2024 · 177 citations
Findings of the IWSLT 2022 Evaluation CampaignInternational Conference on Spoken Language Translation (IWSLT)Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, et al.2022 · 177 citations
BASE Layers: Simplifying Training of Large, Sparse ModelsarXiv:2103.16716Mike Lewis, Shruti Bhosale, Tim Dettmers, et al.2021 · 177 citations
UNKs Everywhere: Adapting Multilingual Language Models to New ScriptsConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2021 · 176 citations
Translation Artifacts in Cross-lingual Transfer LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Mikel Artetxe, Gorka Labaka, Eneko Agirre2020 · 176 citations

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/conneau-2020-unsupervised-cross-lingual-representation-learning/cited-by/

🔗 Who cites «Unsupervised Cross-lingual Representation Learning at Scale»

Who cites «Unsupervised Cross-lingual Representation Learning at Scale»