Eric J. Michaud
Eric J. Michaud has 3 papers in our library, in 2022–2023, most of them on Efficient models & compression; often with Max Tegmark, Ziming Liu, Niklas Nolte.
OpenAlex · ORCID · Wikidata · h-index 7 · 22 works · 232 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 79 times in our library · ⭐ Paper Stars ranking: #7887
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksComputer Science · 3 worksArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Scaling laws · 1 workZipf's law · 1 work
Works by year
2020s
Papers
- Towards Understanding Grokking: An Effective Theory of Representation Learning (2022 · 65 citations)
Grokking is the behavior where a neural network fits its training data early but only begins to generalize much later. - The Quantization Model of Neural Scaling (2023 · 30 citations)
The paper tackles a puzzle about scaling. Average loss falls smoothly as a power law when models and datasets grow, yet specific abilities often seem to switch on abruptly. To reconcile the two, the authors propose the Quantization Hypothesis. It holds that prediction tasks rely on a countable set of discrete skills… - Omnigrok: Grokking Beyond Algorithmic Data (2022 · 29 citations)
Grokking is when a network fits its training data early but only begins to generalize much later. It had been documented mainly on algorithmic tasks, and its cause was unclear. Liu, Michaud and Tegmark study it through loss-landscape geometry. They use a "reduced" loss, obtained by optimizing over weight directions…
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/eric-j-michaud/