Michael Santacroce
Michael Santacroce has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Ahmed Hassan Awadallah, Arindam Mitra, Corby Rosset.
OpenAlex · ORCID · h-index 5 · 10 works · 191 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,044 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #9294
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences (2024 · 44 citations)
Standard RLHF, and contrastive shortcuts such as DPO, assume that preferences derive from a scalar reward (e.g., the Bradley-Terry model). - Efficient RLHF: Reducing the Memory Usage of PPO (2023 · 20 citations)
RLHF with PPO is costly. The PPO stage keeps an actor, a critic, a frozen reference policy and a frozen reward model in memory at once, so it needs more than three times the memory of supervised fine-tuning. That puts it out of reach for many teams. The Microsoft authors measure how several memory-saving variants…
All works
- Direct Nash Optimization: Teaching Language Models to Self-Improve with General PreferencesarXiv:2404.03715Corby Rosset, Ching-An Cheng, Arindam Mitra, et al.2024 · 44 citations
- Efficient RLHF: Reducing the Memory Usage of PPOarXiv:2309.00754Michael Santacroce, Yadong Lu, Han Yu, et al.2023 · 20 citations
- What Matters In The Structured Pruning of Generative Language Models? ↗arXiv (Cornell University) · no summary yetMichael Santacroce et al.2023 · 20 citations
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/michael-santacroce/