Sungnyun Kim
Sungnyun Kim has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining, Efficient models & compression; often with Jongwoo Ko, Se-Young Yun, Tianyi Chen.
OpenAlex · h-index 5 · 11 works · 161 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 140 times in our library · ⭐ Paper Stars ranking: #6263
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 2 worksLanguage models & pretraining · 2 works
Works by year
2020s
Papers
- DistiLLM: Towards Streamlined Distillation for Large Language Models (2024 · 112 citations)
DistiLLM tackles knowledge distillation (KD) for auto-regressive language models, where a large teacher LLM is compressed into a smaller student. - DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (2025 · 32 citations)
Knowledge distillation (KD) for LLMs usually applies the same divergence to teacher-generated outputs (TGOs) and student-generated outputs (SGOs).
Co-authors here
- Jongwoo Ko ×2
- Se-Young Yun ×2
- Tianyi Chen ×2
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/sungnyun-kim/