Peter Albert
Peter Albert has 2 papers in our library, in 2023; often with Amjad Almahairi, Andrew Poulton, Diana Liskovich.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 7,087 times in our library · ⭐ Paper Stars ranking: #352
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksHealth Informatics · 1 workHealth Information Management · 1 workHealth Professions · 1 workMedicine · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Fine-tuning · 1 workLarge language models · 1 work
Works by year
2020s
Papers
- Llama 2: Open Foundation and Fine-Tuned Chat Models (2023 · 9,669 citations)
The paper addresses the gap between open and closed large language models. Open LLMs such as BLOOM, LLaMa-1 or Falcon are already close to GPT-3 and Chinchilla in their base capabilities. However, they cannot replace ready-made chat products like ChatGPT, BARD or Claude, because those are carefully tuned to human… - A Theory on Adam Instability in Large-Scale Machine Learning (2023 · 15 citations)
Very large language models sometimes show sudden loss spikes during training, and the cause has not been explained.
Co-authors here
- Amjad Almahairi
- Andrew Poulton
- Diana Liskovich
- Hugo Touvron
- Igor Molybog
- Louis Martin
- Lukas Blecher
- Moya Chen
- Naman Goyal
- Nikolay Bashlykov
- Prajjwal Bhargava
- Punit Singh Koura
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/peter-albert/