Ian Magnusson
Ian Magnusson has 2 papers in our library, in 2023, most of them on Language models & pretraining, Evaluation & benchmarks; often with Akshita Bhagia, Dirk Groeneveld, Dustin Schwenk.
OpenAlex · h-index 8 · 26 works · 267 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 909 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #7358
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksGeneral Social Sciences · 1 workSocial Sciences · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Evaluation & benchmarks · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- What's In My Big Data? (2023 · 92 citations)
Language models are trained on huge text collections whose contents are rarely documented. Creators usually describe how a corpus was assembled but not what it actually contains. This paper introduces WIMBD (What's In My Big Data?), an open-source toolkit for inspecting and comparing such corpora. It rests on two… - Paloma: A Benchmark for Evaluating Language Model Fit (2023 · 42 citations)
Language models are usually scored by perplexity on one held-out corpus. Such a corpus quietly blends many kinds of text, so a single number cannot show how well a model handles each kind. Paloma (Perplexity Analysis for Language Model Assessment) instead measures fit across 546 fine-grained English and code domains…
All works
- OLMo: Accelerating the Science of Language Models ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDirk Groeneveld et al.2024 · 429 citations
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetLuca Soldaini et al.2024 · 341 citations
- What's In My Big Data?arXiv:2310.20707Yanai Elazar, Akshita Bhagia, Ian Magnusson, et al.2023 · 92 citations
- Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
Co-authors here
- Akshita Bhagia ×2
- Dirk Groeneveld ×2
- Dustin Schwenk ×2
- Luca Soldaini ×2
- Yanai Elazar ×2
- Abhilasha Ravichander
- Alane Suhr
- Iz Beltagy
- Kyle Lo
- Noah A. Smith
- Oyvind Tafjord
- Sameer Singh
Venues
- Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) ×2
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2023
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/ian-magnusson/