Lysandre Debut
Lysandre Debut has 2 papers in our library, in 2019–2020, most of them on Efficient models & compression; often with Julien Chaumond, Thomas Wolf, Victor Sanh.
OpenAlex · h-index 4 · 9 works · 12,615 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 10,234 times in our library · ⭐ Paper Stars ranking: #115
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Natural language processing · 1 workTransformer and attention · 1 work
Works by year
2020s
2010s
Papers
- Transformers: State-of-the-Art Natural Language Processing (2020 · 15,755 citations)
Pretrained Transformer models now drive much of the progress in NLP. Using them in practice raises engineering problems: sharing weights, adapting them to new tasks, comparing architectures fairly, and serving them efficiently. The paper presents Transformers, Hugging Face's open-source library released under Apache… - DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter (2019 · 6,751 citations)
Large pre-trained language models such as BERT deliver high quality. However, they require a lot of memory and computation, which makes them hard to run on smartphones or on a limited budget. The authors from Hugging Face propose DistilBERT: a compact general-purpose model obtained through knowledge distillation…
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/lysandre-debut/