Yehui Tang
Yehui Tang has 7 papers in our library, in 2023–2026, most of them on Language models & pretraining, Reasoning, Efficient models & compression; often with Fangcheng Liu, Kai Han, Yunhe Wang.
OpenAlex · ORCID · h-index 20 · 65 works · 7,073 citations OpenAlex, 2026-10-14
📄 7 works in our library · 🔗 Cited 142 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #7118
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 7 worksArts and Humanities · 6 worksArtificial Intelligence · 7 worksLanguage and Linguistics · 6 worksComputer Vision and Pattern Recognition · 5 worksHardware and Architecture · 2 works
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 5 worksReasoning · 1 workEfficient models & compression · 1 work
Works by year
2020s
Papers
- Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning (2024 · 43 citations)
Prompting schemes such as Chain-of-Thought and Tree-of-Thought usually follow one reasoning attempt to its end. - PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation (2023 · 10 citations)
Progress in large language models has mostly come from adding parameters and data. The design of the Transformer block itself gets little attention, even though large models are costly to run. The authors study LLaMA-style decoders and identify feature collapse: a rank metric shows token representations growing more… - Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs (2025 · 8 citations)
Training MoE language models with nearly a trillion parameters is hard: the hardware is underused because the set of experts each token activates changes at runtime, and the scale strains communication and memory. - PanGu-π Pro:Rethinking Optimization and Architecture for Tiny Language Models (2024 · 8 citations)
On-device deployment needs small language models that still perform well. Most tiny models, however, simply reuse recipes designed for much larger LLMs, and few studies test which of those choices actually suit a ~1B-parameter model. The authors run a systematic set of ablations on a 1B LLaMA-style baseline, trained… - Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUs (2025 · 6 citations)
Pangu Ultra is Huawei's effort to show that a very deep dense Transformer, trained entirely on Ascend NPUs instead of GPUs, can compete with much larger sparse MoE systems. - Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity (2025 · 4 citations)
Sparse Mixture-of-Experts LLMs are cheap per token. However, when experts are spread across accelerators, uneven routing overloads some devices, and the slowest device limits overall speed. The Pangu Team at Huawei proposes Mixture of Grouped Experts (MoGE). Experts are split into equal, non-overlapping groups… - Multi-Granularity Semantic Revision for Large Language Model Distillation (2026 · 2 citations)
The paper addresses white-box knowledge distillation (KD) for auto-regressive LLMs, where a compact student learns from the full output distributions of a larger teacher.
All works
- CMT: Convolutional Neural Networks Meet Vision Transformers ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetJianyuan Guo et al.2022 · 969 citations
- GhostNetV2: Enhance Cheap Operation with Long-Range Attention ↗neural information processing systems · no summary yetYehui Tang et al.2022 · 340 citations
- Vision GNN: An Image is Worth Graph of Nodes ↗neural information processing systems · no summary yetKai Han et al.2022 · 256 citations
- Patch Slimming for Efficient Vision Transformers ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYehui Tang et al.2022 · 204 citations
- Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM ReasoningarXiv:2412.09078Zhenni Bi, Kai Han, Chuanjian Liu, et al.2024 · 43 citations
- PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
- Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUsarXiv:2505.04519Yehui Tang, Yichun Yin, Yaoyuan Wang, et al.2025 · 8 citations
- PanGu-π Pro:Rethinking Optimization and Architecture for Tiny Language ModelsarXiv:2402.02791Yehui Tang, Kai Han, Fangcheng Liu, et al.2024 · 8 citations
- Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUsarXiv:2504.07866Yichun Yin, Wenyong Huang, Kaikai Song, et al.2025 · 6 citations
- Pangu Pro MoE: Mixture of Grouped Experts for Efficient SparsityarXiv:2505.21411Yehui Tang, Xiaosong Li, Fangcheng Liu, et al.2025 · 4 citations
- Multi-Granularity Semantic Revision for Large Language Model DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Liu, Yun Zhang, Wei Li, et al.2026 · 2 citations
Co-authors here
- Fangcheng Liu ×4
- Kai Han ×4
- Yunhe Wang ×4
- Wei Guo ×3
- Yaoyuan Wang ×3
- Hang Zhou ×2
- Hanting Chen ×2
- Xiaojun Meng ×2
- Yichun Yin ×2
- Zheyuan Bai ×2
- Can Chen
- Dong Li
Venues
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings ×2
- neural information processing systems ×2
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yehui-tang/