Jean Mercat
Jean Mercat has 3 papers in our library, in 2024–2025, most of them on Language models & pretraining, Reasoning; often with Sedrick Keh, Georgios Smyrnis, Marianna Nezhurina.
OpenAlex · h-index 3 · 8 works · 38 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 352 times in our library · ⭐ Paper Stars ranking: #5834
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 worksMathematics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Reasoning · 1 workLanguage models & pretraining · 2 works
Works by year
2020s
Papers
- OpenThoughts: Data Recipes for Reasoning Models (2025 · 122 citations)
The strongest reasoning models are usually distilled from training data that is not public, so researchers know little about which data choices actually matter. - Language models scale reliably with over-training and on downstream tasks (2024 · 46 citations)
Scaling laws let teams forecast large language model behaviour from cheap small runs. Most published laws, however, assume Chinchilla-style compute-optimal training and predict only next-token loss. In practice, smaller models are often over-trained on far more tokens to cut inference cost, and they are compared on… - Linearizing Large Language Models (2024 · 16 citations)
Linear-attention models and other recurrent models keep a fixed-size state during generation, which makes inference cheaper than in softmax transformers.
Co-authors here
- Sedrick Keh ×3
- Georgios Smyrnis ×2
- Marianna Nezhurina ×2
- Alex Fang
- Ashima Suvarna
- Etash Guha
- Hritik Bansal
- Jeffrey Li
- Kushal Arora
- Mitchell Wortsman
- Rui Xin
- Rulin Shao
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jean-mercat/