Yanghua Peng
Yanghua Peng has 2 papers in our library, in 2024, most of them on Language models & pretraining, GPU & parallel computing; often with Haibin Lin, Chi Zhang, Chuan Wu.
OpenAlex · ORCID · Wikidata · h-index 15 · 36 works · 1,559 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 817 times in our library · ⭐ Paper Stars ranking: #3192
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksDecision Sciences · 1 workArtificial Intelligence · 2 worksHardware and Architecture · 2 worksInformation Systems and Management · 1 workArts and Humanities · 1 workInformation Systems · 1 workLanguage and Linguistics · 1 work
🧭 Topics 2Research subjects and languages the work is about.GPU & parallel computing · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- HybridFlow: A Flexible and Efficient RLHF Framework (2024 · 624 citations)
RLHF for large language models chains together several large networks across generation, preparation and training stages, with the typical set being the actor and critic alongside a reward model and a reference policy. - MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs (2024 · 157 citations)
When an LLM training job takes over a whole cluster of tens of thousands of GPUs, two engineering problems dominate.
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yanghua-peng/