🧑‍🔬 Naman Goyal — all works

27 works · ← Naman Goyal

1. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Mike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,856 citations
2. RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
3. LLaMA: Open and Efficient Foundation Language ModelsarXiv:2302.13971Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 9,603 citations
4. Unsupervised Cross-lingual Representation Learning at Scale ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetAlexis Conneau et al.2020 · 9,468 citations
5. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksarXiv:2005.11401Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.2020 · 6,256 citations
6. Multilingual Denoising Pre-training for Neural Machine Translation ↗Transactions of the Association for Computational Linguistics · no summary yetYinhan Liu et al.2020 · 2,616 citations
7. OPT: Open Pre-trained Transformer Language ModelsarXiv:2205.01068Susan Zhang, Stephen Roller, Naman Goyal, et al.2022 · 1,755 citations
8. Recipes for Building an Open-Domain ChatbotConference of the European Chapter of the Association for Computational Linguistics (EACL)Stephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,214 citations
9. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleInterspeechArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 807 citations
10. The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation ↗Transactions of the Association for Computational Linguistics · no summary yetNaman Goyal et al.2022 · 770 citations
11. Few-shot Learning with Multilingual Language ModelsarXiv:2112.10668Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, et al.2021 · 500 citations
12. The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsAnnual Meeting of the Association for Computational Linguistics (ACL)Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.2023 · 262 citations
13. Multilingual Translation from Denoising Pre-TrainingFindings of the Association for Computational LinguisticsYuqing Tang, Chau Tran, Xian Li, et al.2021 · 220 citations
14. BASE Layers: Simplifying Training of Large, Sparse Models ↗arXiv:2103.16716 · no summary yetMike Lewis et al.2021 · 177 citations
15. Lifting the Curse of Multilinguality by Pre-training Modular TransformersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Jonas Pfeiffer, Naman Goyal, Xi Victoria Lin, et al.2022 · 174 citations
16. Larger-Scale Transformers for Multilingual Masked Language ModelingWorkshop on Representation Learning for NLPNaman Goyal, Jingfei Du, Myle Ott, et al.2021 · 161 citations
17. Multilingual Autoregressive Entity Linking ↗Transactions of the Association for Computational Linguistics · no summary yetNicola De Cao et al.2022 · 153 citations
18. Few-shot Learning with Multilingual Generative Language Models ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetXi Victoria Lin et al.2022 · 133 citations
19. XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Davis Liang, Hila Gonen, Yuning Mao, et al.2023 · 120 citations
20. Efficient Large Scale Language Modeling with Mixtures of Experts ↗arXiv:2112.10684 · no summary yetMikel Artetxe et al.2021 · 113 citations
21. Better Fine-Tuning by Reducing Representational Collapse ↗arXiv (Cornell University) · no summary yetArmen Aghajanyan et al.2020 · 109 citations
22. CM3: A Causal Masked Multimodal Model of the Internet ↗arXiv (Cornell University) · no summary yetArmen Aghajanyan et al.2022 · 104 citations
23. Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and AlignmentConference on Machine Translation (WMT)Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, et al.2020 · 101 citations
24. Scaling Laws for Generative Mixed-Modal Language ModelsarXiv:2301.03728Armen Aghajanyan, Lili Yu, Alexis Conneau, et al.2023 · 45 citations
25. How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training? ↗Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track) · no summary yetShiyue Zhang et al.2022 · 25 citations
26. On the Role of Bidirectionality in Language Model Pre-Training ↗Findings of the Association for Computational Linguistics: EMNLP 2022 · no summary yetMikel Artetxe et al.2022 · 17 citations
27. A Theory on Adam Instability in Large-Scale Machine Learning ↗arXiv:2304.09871 · no summary yetIgor Molybog et al.2023 · 15 citations

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/naman-goyal/works/