Hanting Chen
Hanting Chen has 4 papers in our library, in 2023–2026, most of them on Language models & pretraining, Information retrieval & search, Efficient models & compression; often with Kai Han, Yehui Tang, Yunhe Wang.
OpenAlex · h-index 21 · 75 works · 8,177 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 40 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #8720
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 4 worksArtificial Intelligence · 4 worksArts and Humanities · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 works
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 3 worksEfficient models & compression · 1 workInformation retrieval & search · 1 work
Works by year
2020s
Papers
- Pangu Embedded: An Efficient Dual-system LLM Reasoner with Metacognition (2025 · 13 citations)
Reasoning-focused LLMs such as DeepSeek-R1 are expensive to deploy because they are very large and generate long chains of thought, sometimes tens of thousands of tokens per problem. - PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation (2023 · 10 citations)
Progress in large language models has mostly come from adding parameters and data. The design of the Transformer block itself gets little attention, even though large models are costly to run. The authors study LLaMA-style decoders and identify feature collapse: a rank metric shows token representations growing more… - Multi-Granularity Semantic Revision for Large Language Model Distillation (2026 · 2 citations)
The paper addresses white-box knowledge distillation (KD) for auto-regressive LLMs, where a compact student learns from the full output distributions of a larger teacher. - MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers (2026)
Sparse-attention LLMs, such as models built on sliding windows, save compute and memory. They tend to fail, however, when an answer depends on recalling an exact detail far back in the input. MATCH tackles this by pairing a sparsified Transformer with a lightweight retrieval component that treats the prompt itself as…
All works
- Data-Free Learning of Student Networks ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetHanting Chen et al.2019 · 357 citations
- Image Processing GNN: Breaking Rigidity in Super-Resolution ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYuchuan Tian et al.2024 · 52 citations
- Pangu Embedded: An Efficient Dual-system LLM Reasoner with MetacognitionarXiv:2505.22375Hanting Chen, Yasheng Wang, Kai Han, et al.2025 · 13 citations
- PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
- Multi-Granularity Semantic Revision for Large Language Model DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Liu, Yun Zhang, Wei Li, et al.2026 · 2 citations
- MATCH: Modulating Attention via In-Context Retrieval for Long-Context TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Linrui Ma, Chun Hei Lo, Xinyu Wang, et al.2026
Co-authors here
- Kai Han ×3
- Yehui Tang ×2
- Yunhe Wang ×2
- Bin Wang
- Dong Li
- Fangcheng Liu
- Fei Mi
- Haoyu Wang
- Jinpeng Li
- Kaikai Song
- Lifeng Shang
- Lin Li
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2026 ×2
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- IEEE/CVF International Conference on Computer Vision (ICCV)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/hanting-chen/