🔗 Who cites «What Language Model to Train if You Have One Million GPU Hours?»

67 papers of our library cite it (of the 149,439 whose bibliographies we read) · 23 with a page here, the most cited first · ← back to «What Language Model to Train if You Have One Million GPU Hours?»

1. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
2. Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
3. BloombergGPT: A Large Language Model for FinancearXiv:2303.17564Shijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 618 citations
4. Few-shot Learning with Multilingual Language ModelsarXiv:2112.10668Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, et al.2021 · 500 citations
5. The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
6. Aya Dataset: An Open-Access Collection for Multilingual Instruction TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Shivalika Singh, Freddie Vargus, Daniel D'souza, et al.2024 · 207 citations
7. Will we run out of data? Limits of LLM scaling based on human-generated dataarXiv:2211.04325Pablo Villalobos, Anson Ho, Jaime Sevilla, et al.2022 · 198 citations
8. DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
9. Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
10. The Impact of Positional Encoding on Length Generalization in TransformersConference on Neural Information Processing Systems (NeurIPS)Amirhossein Kazemnejad, Inkit Padhi, Karthikeyan Natesan Ramamurthy, et al.2023 · 134 citations
11. EuroLLM: Multilingual Language Models for EuropearXiv:2409.16235Pedro Henrique Martins, Patrick Fernandes, Joao Alves, et al.2024 · 133 citations
12. Emergent and Predictable Memorization in Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Stella Biderman, USVSN Sai Prashanth, Lintang Sutawika, et al.2023 · 123 citations
13. Transformer Language Models without Positional Encodings Still Learn Positional InformationarXiv:2203.16634Adi Haviv, Ori Ram, Ofir Press, et al.2022 · 111 citations
14. A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
15. Large Language Models in Law: A SurveyarXiv:2312.03718Jinqi Lai, Wensheng Gan, Jiayang Wu, et al.2023 · 80 citations
16. FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Konstantin Dobler, Gerard de Melo2023 · 62 citations
17. Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
18. Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
19. EuroLLM-9B: Technical ReportarXiv:2506.04079Pedro Henrique Martins, Joao Alves, Patrick Fernandes, et al.2025 · 45 citations
20. Efficient Language Model Training through Cross-Lingual and Progressive Transfer LearningarXiv:2301.09626Malte Ostendorff, Georg Rehm2023 · 36 citations
21. TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormerarXiv:2307.14995Zhen Qin, Dong Li, Weigao Sun, et al.2023 · 33 citations
22. Merge and Conquer: Instructing Multilingual Models by Adding Target Language WeightsLanguage Resources and Evaluation Conference (LREC)Eneko Valero, Maria Ribalta i Albado, Oscar Sainz, et al.2026
23. 360Zhinao Technical ReportarXiv:2405.133862024

44 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/scao-2022-language-model-train-if-have/cited-by/