Diana Liskovich
Diana Liskovich has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Efficient models & compression; often with Akshat Shrivastava, Andrew Poulton, Beidi Chen.
OpenAlex · h-index 3 · 7 works · 2,630 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 7,210 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #7113
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding (2024 · 156 citations)
Serving large language models is costly because every generated token passes through all transformer layers. - A Theory on Adam Instability in Large-Scale Machine Learning (2023 · 15 citations)
Very large language models sometimes show sudden loss spikes during training, and the cause has not been explained.
All works
- LayerSkip: Enabling Early Exit Inference and Self-Speculative DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, et al.2024 · 156 citations
- Simple Local Attentions Remain Competitive for Long-Context Tasks ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetWenhan Xiong et al.2022 · 22 citations
- A Theory on Adam Instability in Large-Scale Machine LearningarXiv:2304.09871Igor Molybog, Peter Albert, Moya Chen, et al.2023 · 15 citations
Co-authors here
- Akshat Shrivastava
- Andrew Poulton
- Beidi Chen
- Igor Molybog
- Moya Chen
- Naman Goyal
- Peter Albert
- Punit Singh Koura
- Sharan Narang
- Zachary DeVito
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2024
- Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/diana-liskovich/