Taiqiang Wu
Taiqiang Wu has 3 papers in our library, in 2025–2026, most of them on Language models & pretraining, Reasoning, Efficient models & compression; often with Runming Yang, Jiahao Wang, Ngai Wong.
OpenAlex · ORCID · h-index 5 · 54 works · 130 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 54 times in our library · ⭐ Paper Stars ranking: #7614
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 works
🧭 Topics 3Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 workReasoning · 1 work
Works by year
2020s
Papers
- Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models (2025 · 47 citations)
Distilling large language models usually means training a student to match the teacher's next-token distribution with a Kullback-Leibler loss. - Revisiting Model Interpolation for Efficient Reasoning (2026 · 6 citations)
The paper looks at efficient reasoning: how to keep the accuracy of long chain-of-thought models while producing fewer tokens. - ProFit: Leveraging High-Value Signals in SFT via Probability-Guided Token Selection (2026 · 4 citations)
Standard supervised fine-tuning (SFT) trains an LLM to reproduce one reference answer token by token. Valid alternative phrasings are therefore penalized, and the model tends to memorize surface wording. Training on several references per prompt could help, but the authors find it expensive and unstable. They instead…
Co-authors here
- Runming Yang ×3
- Jiahao Wang ×2
- Ngai Wong ×2
- Tao Liu ×2
- Chaofan Tao
- Junjie Wang
- Shaoning Sun
- Yujiu Yang
- Zhe Zhao
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- International Conference on Computational Linguistics (COLING): COLING 2025
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/taiqiang-wu/