🧑‍🔬 Niklas Muennighoff — all works

31 works · ← Niklas Muennighoff

1. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
2. MTEB: Massive Text Embedding BenchmarkConference of the European Chapter of the Association for Computational Linguistics (EACL)Niklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,032 citations
3. C-Pack: Packed Resources For General Chinese EmbeddingsInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Shitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 922 citations
4. StarCoder: may the source be with you! ↗arXiv:2305.06161 · no summary yetRaymond Li et al.2023 · 732 citations
5. Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
6. s1: Simple test-time scalingConference on Empirical Methods in Natural Language Processing (EMNLP)Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 608 citations
7. OLMo: Accelerating the Science of Language Models ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDirk Groeneveld et al.2024 · 429 citations
8. Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetLuca Soldaini et al.2024 · 341 citations
9. KTO: Model Alignment as Prospect Theoretic Optimization ↗arXiv:2402.01306 · no summary yetKawin Ethayarajh et al.2024 · 333 citations
10. Scaling Data-Constrained Language Models ↗arXiv:2305.16264 · no summary yetNiklas Muennighoff et al.2023 · 249 citations
11. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
12. SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904Niklas Muennighoff2022 · 189 citations
13. Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
14. SantaCoder: don't reach for the stars!arXiv:2301.03988Loubna Ben Allal, Raymond Li, Denis Kocetkov, et al.2023 · 167 citations
15. BLOOM+1: Adding Language Support to BLOOM for Zero-Shot PromptingAnnual Meeting of the Association for Computational Linguistics (ACL)Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, et al.2023 · 102 citations
16. Lessons from the Trenches on Reproducible Evaluation of Language Models ↗arXiv:2405.14782 · no summary yetStella Biderman et al.2024 · 99 citations
17. A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
18. A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?arXiv:2503.24235Qiyuan Zhang, Fuyuan Lyu, Zexu Sun, et al.2025 · 79 citations
19. BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive RetrievalarXiv:2407.12883Hongjin Su, Howard Yen, Mengzhou Xia, et al.2024 · 77 citations
20. KMMLU: Measuring Massive Multitask Language Understanding in KoreanConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guijin Son, Hanwool Lee, Sungdong Kim, et al.2025 · 76 citations
21. What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
22. RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492Qian Liu, Xiaosen Zheng, Niklas Muennighoff, et al.2024 · 57 citations
23. SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains? ↗arXiv (Cornell University) · no summary yetJohn Jeongseok Yang et al.2024 · 48 citations
24. Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
25. ReasonIR: Training Retrievers for Reasoning Tasks ↗arXiv (Cornell University) · no summary yetRulin Shao et al.2025 · 41 citations
26. The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding ↗arXiv:2406.02396 · no summary yetKenneth Enevoldsen et al.2024 · 23 citations
27. Astraios: Parameter-Efficient Instruction Tuning Code Large Language ModelsarXiv:2401.00788Terry Yue Zhuo, Armel Zebaze, Nitchakarn Suppattarachai, et al.2024 · 21 citations
28. The Hateful Memes Challenge: Competition Report ↗UvA-DARE (University of Amsterdam) · no summary yetDouwe Kiela et al.2020 · 20 citations
29. UQ: Assessing Language Models on Unsolved Questions ↗arXiv (Cornell University) · no summary yetNie, Fan et al.2025 · 6 citations
30. FlexOLMo: Open Language Models for Flexible Data Use ↗neural information processing systems · no summary yetWeijia Shi et al.2025 · 5 citations
31. Prefix Sliding for efficient test-time scaling ↗arXiv (Cornell University) · no summary yetNiklas Muennighoff et al.2026 · 1 citation

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/niklas-muennighoff/works/