Jean Kaddour
Jean Kaddour has 2 papers in our library, in 2023, most of them on Language models & pretraining; often with Herbie Bradley, Maximilian Mozes, Roberta Raileanu.
OpenAlex · h-index 7 · 30 works · 424 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 547 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #4692
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- Challenges and Applications of Large Language Models (2023 · 301 citations)
The number of papers on large language models has grown so fast that newcomers struggle to see which problems remain open and where these systems already deliver value. - The MiniPile Challenge for Data-Efficient Language Models (2023 · 41 citations)
New ideas in Transformer design, optimizers and training recipes are usually tested on small, single-domain corpora such as enwik8 or WikiText103.
All works
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- The MiniPile Challenge for Data-Efficient Language ModelsarXiv:2304.08442Jean Kaddour2023 · 41 citations
- No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models ↗arXiv:2307.06440 · no summary yetJean Kaddour et al.2023 · 30 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jean-kaddour/