Nino Vieillard
Nino Vieillard has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Efficient models & compression; often with Piotr Stanczyk, Alexandre Rame, Geoffrey Cideron.
OpenAlex · h-index 10 · 32 works · 1,282 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 4,928 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #5542
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 2 worksLanguage models & pretraining · 2 works
Works by year
2020s
Papers
- On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes (2023 · 299 citations)
Distilling a large autoregressive language model into a smaller student usually means training on a fixed set of sequences, either ground-truth targets or outputs the teacher generated. - BOND: Aligning LLMs with Best-of-N Distillation (2024 · 23 citations)
Best-of-N sampling draws N responses from a reference model and keeps the one a reward model scores highest.
All works
- Gemma 2: Improving Open Language Models at a Practical Size ↗arXiv:2408.00118 · no summary yetGemma Team et al.2024 · 1,302 citations
- Gemma 3 Technical Report ↗arXiv:2503.19786 · no summary yetGemma Team et al.2025 · 1,147 citations
- On-Policy Distillation of Language Models: Learning from Self-Generated MistakesarXiv:2306.13649Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, et al.2023 · 299 citations
- BOND: Aligning LLMs with Best-of-N DistillationarXiv:2407.14622Pier Giuseppe Sessa, Robert Dadashi, Leonard Hussenot, et al.2024 · 23 citations
Co-authors here
- Piotr Stanczyk ×2
- Alexandre Rame
- Geoffrey Cideron
- Johan Ferret
- Leonard Hussenot
- Matthieu Geist
- Rishabh Agarwal
- Robert Dadashi
- Sarah Perrin
- Sertan Girgin
- Yongchao Zhou
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/nino-vieillard/