Yunhe Wang
Yunhe Wang has 4 papers in our library, in 2023–2026, most of them on Language models & pretraining, Reasoning, Efficient models & compression; often with Yehui Tang, Kai Han, Fangcheng Liu.
OpenAlex · ORCID · Wikidata · h-index 25 · 160 works · 2,258 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 62 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #7468
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 4 worksArtificial Intelligence · 4 worksArts and Humanities · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 works
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 4 worksReasoning · 1 workEfficient models & compression · 1 work
Works by year
2020s
Papers
- Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning (2024 · 43 citations)
Prompting schemes such as Chain-of-Thought and Tree-of-Thought usually follow one reasoning attempt to its end. - PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation (2023 · 10 citations)
Progress in large language models has mostly come from adding parameters and data. The design of the Transformer block itself gets little attention, even though large models are costly to run. The authors study LLaMA-style decoders and identify feature collapse: a rank metric shows token representations growing more… - PanGu-π Pro:Rethinking Optimization and Architecture for Tiny Language Models (2024 · 8 citations)
On-device deployment needs small language models that still perform well. Most tiny models, however, simply reuse recipes designed for much larger LLMs, and few studies test which of those choices actually suit a ~1B-parameter model. The authors run a systematic set of ablations on a 1B LLaMA-style baseline, trained… - Multi-Granularity Semantic Revision for Large Language Model Distillation (2026 · 2 citations)
The paper addresses white-box knowledge distillation (KD) for auto-regressive LLMs, where a compact student learns from the full output distributions of a larger teacher.
All works
- ZINB-Based Graph Embedding Autoencoder for Single-Cell RNA-Seq Interpretations ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetZhuohan Yu et al.2022 · 110 citations
- Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM ReasoningarXiv:2412.09078Zhenni Bi, Kai Han, Chuanjian Liu, et al.2024 · 43 citations
- PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
- PanGu-π Pro:Rethinking Optimization and Architecture for Tiny Language ModelsarXiv:2402.02791Yehui Tang, Kai Han, Fangcheng Liu, et al.2024 · 8 citations
- Multi-Granularity Semantic Revision for Large Language Model DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Liu, Yun Zhang, Wei Li, et al.2026 · 2 citations
Co-authors here
- Yehui Tang ×4
- Kai Han ×3
- Fangcheng Liu ×2
- Hanting Chen ×2
- Zheyuan Bai ×2
- Tianyu Guo
- Wei Li
- Xiaoyu Liu
- Yun Wang
- Zhenni Bi
- Zhicheng Liu
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Proceedings of the AAAI Conference on Artificial Intelligence
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yunhe-wang/