Yao Chen
Yao Chen has 3 papers in our library, in 2021–2026, most of them on Reasoning, Efficient models & compression; often with Tingwen Liu, Wenyuan Zhang, Deming Chen.
OpenAlex · ORCID · h-index 13 · 75 works · 696 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 79 times in our library · ⭐ Paper Stars ranking: #5540
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 works
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workReasoning · 2 works
Works by year
2020s
Papers
- Compressing Large-Scale Transformer-Based Models: A Case Study on BERT (2021 · 190 citations)
Large pre-trained Transformers such as BERT deliver strong NLP results, but their size, memory footprint, and latency make them hard to run on phones, latency-sensitive services, or modest research hardware. - AttnPO: Attention-Guided Process Supervision for Efficient Reasoning (2026 · 18 citations)
Reasoning models trained with RLVR tend to overthink, producing long chains of thought with little benefit. - Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information (2025 · 10 citations)
Small language models are cheaper to deploy than large ones but reason less well. Chain-of-Thought (CoT) distillation usually just trains them on teacher-written rationales, with every token weighted the same. The authors observe that teacher models such as Llama3-8B shift their attention from step to step toward the…
Co-authors here
- Tingwen Liu ×2
- Wenyuan Zhang ×2
- Deming Chen
- Hassan Sajjad
- Hua Ren Wu
- Jiawei Sheng
- Linhao Yu
- Preslav Nakov
- Shuaiyi Nie
- Weichong Yin
- Yu Sun
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025
- Transactions of the Association for Computational Linguistics (TACL): Transactions of the Association for Computational Linguistics (TACL) 2021
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yao-chen/