Niklas Muennighoff
current affiliationStanford University, Stanford, United States
Niklas Muennighoff has 8 papers on this site, in 2022–2025, most of them on Language models & pretraining, Multilingual & cross-lingual NLP, Evaluation & benchmarks; often with Adam Roberts, Alex Gu, Amanpreet Singh.
OpenAlex · ORCID · h-index 24 · 103 works · 4 251 citations OpenAlex, 2026-10-14
8 works on this site · 5 652 citations in our library · 13 more works in our library
Affiliations
- Stanford University · Stanford, United States — current · 2024–2026 on 14 papers
- Allen Institute for Artificial Intelligence · Seattle, United States — 2025 on 3 papers
- National Library of Finland · Helsinki — 2023–2025 on 3 papers
- Cohere (Canada) · San Francisco — 2024 on 4 papers
- Peking University · Beijing, China — 2021–2024 on 4 papers
- Carnegie Mellon University · Pittsburgh, United States — 2024 on 3 papers
- New York University · New York, United States — 2022–2024 on 3 papers
- University of Washington · Seattle, United States — 2024 on 2 papers
- Hugging Face · New York, United States — 2023 on 2 papers
- University of Cambridge · Cambridge, United Kingdom — 2022–2023 on 2 papers
Topics
Papers
- MTEB: Massive Text Embedding Benchmark (2022 · 1 021 citations)
Text embedding models are usually tested on only a few datasets, most often semantic textual similarity (STS). - C-Pack: Packed Resources For General Chinese Embeddings (2023 · 920 citations)
Chinese has lagged behind English in general-purpose text embeddings because it lacks large public training sets, competitive models and a broad evaluation suite. - Crosslingual Generalization through Multitask Finetuning (2022 · 692 citations)
Multitask prompted finetuning (MTF) helps large language models handle unseen tasks zero-shot, but earlier studies stayed almost entirely within English. - s1: Simple test-time scaling (2025 · 584 citations)
The paper looks for the least machinery needed to reproduce what OpenAI's o1 showed: a model that gets more accurate when it is allowed to think longer at inference time. - SGPT: GPT Sentence Embeddings for Semantic Search (2022 · 187 citations)
Large GPT-style decoder models lead many language tasks, but semantic search and sentence embeddings have remained the domain of much smaller BERT-like encoders. - Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models (2024 · 184 citations)
The strongest vision-language models (VLMs) are closed. Most capable open-weight alternatives are trained on captions or answers produced by proprietary systems such as GPT-4V. In effect they distill closed models, so it remains unclear how to build a strong VLM from scratch. The authors release Molmo, a family of… - Generative Representational Instruction Tuning (2024 · 165 citations)
LLMs are usually specialised. A model tuned for text generation produces weak embeddings, and a model tuned for embeddings loses its ability to generate. This paper introduces GRIT (generative representational instruction tuning), which trains one LLM on both kinds of data. The instruction format tells the model… - SantaCoder: don't reach for the stars! (2023 · 164 citations)
Most code LLMs are built with little transparency: training data, preprocessing, and design choices are rarely disclosed.
Also in our library
Co-authors here
- Adam Roberts
- Alex Gu
- Amanpreet Singh
- Carolyn Jane Anderson
- Chenghao Mou
- Christopher Akiki
- Christopher Clark
- Defu Lian
- Douwe Kiela
- Dragomir Radev
- Furu Wei
- Hailey Schoelkopf
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/niklas-muennighoff/