Jeffrey Li
Jeffrey Li has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Alex Fang, Georgios Smyrnis, Rui Xin.
OpenAlex · ORCID · h-index 4 · 25 works · 67 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 223 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #5388
Affiliations
🏥Charité - Universitätsmedizin BerlinBerlin ·
Germany2025–2026 · 5 papersEmployment🏥City Of Hope National Medical CenterDuarte ·
United States2024–2026 · 4 papers🔬German Centre for Cardiovascular ResearchBerlin ·
Germany2025–2026 · 4 papers🎓Humboldt-Universität zu BerlinBerlin ·
Germany2025–2026 · 4 papers🏥Deutsches Herzzentrum der CharitéBerlin ·
Germany2025–2026 · 3 papers🎓Carnegie Mellon UniversityPittsburgh ·
United States2025–2026 · 2 papers🎓Boston UniversityBoston ·
United States2026 · 1 paper🎓Freie Universität BerlinBerlin ·
Germany2026 · 1 paper🎓Georgia Institute of TechnologyAtlanta ·
United States2024 · 4 papers🎓University of WashingtonSeattle ·
United States2024–2025 · 3 papers
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- DataComp-LM: In search of the next generation of training sets for language models (2024 · 191 citations)
Pretraining datasets for language models are hard to compare fairly. Published models also differ in architecture, compute and hyperparameters, and the developers of top open-weight models seldom disclose their training data. DCLM (DataComp for Language Models) is a benchmark that fixes the training recipe so that… - Language models scale reliably with over-training and on downstream tasks (2024 · 46 citations)
Scaling laws let teams forecast large language model behaviour from cheap small runs. Most published laws, however, assume Chinchilla-style compute-optimal training and predict only next-token loss. In practice, smaller models are often over-trained on far more tokens to cut inference cost, and they are compared on…
All works
- DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- Better Alignment with Instruction Back-and-Forth Translation ↗Findings of the Association for Computational Linguistics: EMNLP 2024 · no summary yetThao Nguyen et al.2024 · 10 citations
Co-authors here
- Alex Fang ×2
- Georgios Smyrnis ×2
- Rui Xin ×2
- Samir Yitzhak Gadre ×2
- Sedrick Keh ×2
- Etash Guha
- Hritik Bansal
- Jean Mercat
- Kushal Arora
- Maor Ivgi
- Marianna Nezhurina
- Mitchell Wortsman
Venues
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
- Findings of the Association for Computational Linguistics: EMNLP 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jeffrey-li/