Yicheng Li
Yicheng Li has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Reasoning, Efficient models & compression; often with Chenglin Li, Yin Zhang, Fei Yu.
OpenAlex · ORCID · h-index 12 · 58 works · 600 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 29 times in our library · ⭐ Paper Stars ranking: #8405
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 2 worksReasoning · 2 worksEfficient models & compression · 1 work
Works by year
2020s
Papers
- Teaching Small Language Models Reasoning through Counterfactual Distillation (2024 · 21 citations)
The paper addresses a weakness of chain-of-thought (CoT) distillation, where a large teacher model's rationales are used to fine-tune small language models (SLMs). - Mixed Distillation Helps Smaller Language Model Better Reasoning (2023 · 11 citations)
Large language models reason well but are expensive to run. Earlier work on distilling reasoning into compact models mostly transfers only natural-language Chain of Thought (CoT). This paper argues that Program of Thought (PoT), where the model writes executable Python, is a valuable extra training signal. The…
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yicheng-li/