Alexander Hägele
Alexander Hägele has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining; often with Alejandro Hernández-Cano, Angelika Romanou, Bettina Messmer.
OpenAlex · h-index 2 · 8 works · 20 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 75 times in our library · ⭐ Paper Stars ranking: #5116
Affiliations
Concepts, shelves and topics
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Scaling laws · 1 work
Works by year
2020s
Papers
- Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026 · 67 citations)
Most "open" LLMs release only their weights. Their training data stays undisclosed, may ignore content owners' rights, and is heavily skewed toward English and a few high-resource languages. Apertus responds with a fully open suite of 8B and 70B models, both base and Instruct. Pretraining used 15T tokens drawn only… - Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations (2024 · 26 citations)
The paper questions the habit of training large language models with a cosine learning rate schedule. This schedule performs best solely when its cycle is set to equal the full training duration. As a result, the model has to be trained from scratch for every token budget, which makes scaling laws studies expensive.…
Co-authors here
- Alejandro Hernández-Cano
- Angelika Romanou
- Bettina Messmer
- Elie Bakouch
- Leandro Von Werra
- Loubna Ben Allal
- Martin Jaggi
- Mete Ismayilzada
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/alexander-hagele/