Chen-Yu Lee
Chen-Yu Lee has 4 papers in our library, in 2023–2026, most of them on Language models & pretraining, Reasoning; often with Tomas Pfister, Zifeng Wang, Hootan Nakhost.
OpenAlex · h-index 20 · 74 works · 5,767 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 874 times in our library · 10 more in our library without a page yet · ⭐ Paper Stars ranking: #2953
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 4 worksLanguage and Linguistics · 3 worksComputer Science · 4 worksArts and Humanities · 3 worksMathematics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksReasoning · 1 work
Works by year
2020s
Papers
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes (2023 · 690 citations)
Small task-specific models are cheap to serve, but they usually need many human labels (finetuning) or large pools of unlabeled data (distillation from an LLM) to approach LLM quality. - Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling (2024 · 41 citations)
Distilling a large language model into a smaller one runs into two failure modes. Supervised KD trains on a fixed set of outputs, so it never sees the kind of text the student produces at inference time. On-policy KD trains on the student's own generations, but early on these are often poor and unfamiliar to the… - PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem Solving (2025 · 16 citations)
LLM-based agents and test-time search methods often fail on "natural planning" tasks, such as scheduling meetings or planning trips described in plain language. - When One LLM Drools, Multi-LLM Collaboration Rules (2026 · 14 citations)
This position paper by Feng et al. (ACL 2026) argues that a single general-purpose LLM cannot reliably handle complex, context-dependent, or subjective settings. It contributes no new dataset or model. Instead, it makes a conceptual case that any one model leaves gaps on three fronts. It misses parts of real-world…
All works
- Deeply-Supervised Nets ↗arXiv (Cornell University) · no summary yetChen‐Yu Lee et al.2014 · 1,062 citations
- Learning to Prompt for Continual Learning ↗arXiv:2112.08654 · no summary yetZifeng Wang et al.2021 · 855 citations
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model SizesFindings of the Association for Computational LinguisticsCheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, et al.2023 · 690 citations
- Sliced Wasserstein Discrepancy for Unsupervised Domain Adaptation ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetChen‐Yu Lee et al.2019 · 586 citations
- Recursive Recurrent Nets with Attention Modeling for OCR in the Wild ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetChen‐Yu Lee, Simon Osindero2016 · 471 citations
- FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetChen-Yu Lee et al.2022 · 106 citations
- Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding ↗arXiv:2401.04398 · no summary yetZilong Wang et al.2024 · 105 citations
- Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Models ↗arXiv (Cornell University) · no summary yetCheng-Yu Hsieh et al.2023 · 71 citations
- Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization ↗Findings of the Association for Computational Linguistics: ACL 2024 · no summary yetCheng-Yu Hsieh et al.2024 · 61 citations
- Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved SamplingarXiv:2410.11325Wenda Xu, Rujun Han, Zifeng Wang, et al.2024 · 41 citations
- PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem SolvingConference on Empirical Methods in Natural Language Processing (EMNLP)Mihir Parmar, Xin Liu, Palash Goyal, et al.2025 · 16 citations
- When One LLM Drools, Multi-LLM Collaboration RulesAnnual Meeting of the Association for Computational Linguistics (ACL)Shangbin Feng, Wenxuan Ding, Alisa Liu, et al.2026 · 14 citations
- Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systems ↗neural information processing systems · no summary yetShangbin Feng et al.2025 · 7 citations
- SAGE: Steerable Agentic Data Generation for Deep Search with Execution Feedback ↗Findings of the Association for Computational Linguistics: EACL 2026 · no summary yetFangyuan Xu et al.2026
Co-authors here
- Tomas Pfister ×3
- Zifeng Wang ×3
- Hootan Nakhost ×2
- Long Le ×2
- Alexander Ratner
- Alisa Liu
- Cheng-Yu Hsieh
- Chitta Baral
- Chun-Liang Li
- Hunter Lang
- Jindong Gu
- Lei Li
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×3: ACL 2026
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings ×2
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2023
- Findings of the Association for Computational Linguistics: ACL 2024
- Findings of the Association for Computational Linguistics: EACL 2026
- neural information processing systems
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/chen-yu-lee/