Tianyi Chen
Tianyi Chen has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining, Efficient models & compression; often with Jongwoo Ko, Se-Young Yun, Sungnyun Kim.
OpenAlex · ORCID · h-index 17 · 65 works · 770 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 140 times in our library · ⭐ Paper Stars ranking: #6264
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 2 worksLanguage models & pretraining · 2 works
Works by year
2020s
Papers
- DistiLLM: Towards Streamlined Distillation for Large Language Models (2024 · 112 citations)
DistiLLM tackles knowledge distillation (KD) for auto-regressive language models, where a large teacher LLM is compressed into a smaller student. - DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (2025 · 32 citations)
Knowledge distillation (KD) for LLMs usually applies the same divergence to teacher-generated outputs (TGOs) and student-generated outputs (SGOs).
Co-authors here
- Jongwoo Ko ×2
- Se-Young Yun ×2
- Sungnyun Kim ×2
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tianyi-chen/