Peng Cheng
Peng Cheng has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining; often with Biye Li, Bo Zhu, Cheng Cheng.
OpenAlex · ORCID · h-index 20 · 95 works · 2,175 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 20 times in our library · ⭐ Paper Stars ranking: #8954
Affiliations
🎓University of FloridaGainesville ·
United States2023–2026 · 13 papers🎓University of Florida HealthGainesville ·
United States2024–2026 · 4 papers🎓Xidian UniversityXi'an ·
China2018–2022 · 11 papers🎓Naval University of EngineeringWuhan ·
China2009–2023 · 10 papers🎓Peking UniversityBeijing ·
China2010–2020 · 5 papers🏢MicrosoftRedmond ·
United States2019–2025 · 4 papers🏢Guangzhou Automobile GroupGuangzhou ·
China2024–2025 · 3 papers🎓La Trobe UniversityMelbourne ·
Australia2022–2023 · 3 papers🏛️Chinese Academy of SciencesBeijing ·
China2016–2025 · 2 papers🎓Huazhong University of Science and TechnologyWuhan ·
China2014–2023 · 2 papers
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models (2024 · 21 citations)
Training sparse Mixture-of-Experts (MoE) LLMs involves several practical choices whose effects are poorly understood. - Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training (2026 · 1 citation)
Continual pre-training of an LLM on a narrow target field, such as math, often causes catastrophic forgetting of general skills.
Co-authors here
- Biye Li
- Bo Zhu
- Cheng Cheng
- Hao Li
- Jianhao Zhang
- Kailai Yang
- Lei Ji
- Liang Zeng
- Liang Zhao
- Mao Yang
- Tianwen Wei
- Weiwei L\"u
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/peng-cheng/