Fabian Gloeckle
Fabian Gloeckle has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Baptiste Rozière, David Lopez-Paz, Gabriel Synnaeve.
OpenAlex · h-index 3 · 14 works · 457 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,076 times in our library · ⭐ Paper Stars ranking: #1984
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksInformation Systems · 2 worksLanguage and Linguistics · 2 worksComputer Science Applications · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
💡 Concepts 1Key ideas and methods explained on our concept pages.Large language models · 1 work
Works by year
2020s
Papers
- Code Llama: Open Foundation Models for Code (2024 · 1,430 citations)
Code Llama is Meta AI's family of open code-oriented language models. Rather than training a code model from scratch, the authors take pretrained Llama 2 weights and specialize them through a chain of training stages. The main stage trains on a code-dominated, near-deduplicated corpus of public code, with some… - Better & Faster Large Language Models via Multi-token Prediction (2024 · 90 citations)
LLMs such as GPT and Llama learn by guessing only the single next token. The authors argue this objective needs a lot of data and favours short-range patterns. Gloeckle et al. (FAIR at Meta) instead train models to forecast several upcoming tokens from every position. A shared transformer trunk feeds n separate…
Co-authors here
- Baptiste Rozière ×2
- David Lopez-Paz
- Gabriel Synnaeve
- Itai Gat
- Jingyu Liu
- Jonas Gehring
- Xiaoqing Ellen Tan
- Yossi Adi
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/fabian-gloeckle/