Yanping Huang
Yanping Huang has 3 papers in our library, in 2021–2023, most of them on Language models & pretraining; often with Hao Zhang, Lianmin Zheng, Yuanzhong Xu.
OpenAlex · ORCID · Wikidata · h-index 17 · 189 works · 1,188 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 698 times in our library · ⭐ Paper Stars ranking: #2822
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArtificial Intelligence · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 workComputer Networks and Communications · 2 worksHardware and Architecture · 2 worksComputer Vision and Pattern Recognition · 1 workInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- GLaM: Efficient Scaling of Language Models with Mixture-of-Experts (2021 · 496 citations)
Scaling dense language models such as GPT-3 improves few-shot learning, but the compute and energy needed to train and serve them grow steeply. - Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning (2022 · 279 citations)
Training models with billions of parameters requires combining data, operator and pipeline parallelism. Until now, engineers either designed that combination by hand for a specific model and cluster, as with Megatron-LM's "3D parallelism", or used automatic tools that search only one kind of parallelism. Alpa takes a… - AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (2023 · 170 citations)
AlpaServe asks how to serve many large deep learning models on a shared GPU cluster when request traffic is highly bursty.
Co-authors here
- Hao Zhang ×2
- Lianmin Zheng ×2
- Yuanzhong Xu ×2
- Zhifeng Chen ×2
- Zhuohan Li ×2
- Adams Wei Yu
- Andrew M. Dai
- Barret Zoph
- Danyang Zhuo
- Dmitry Lepikhin
- Eric P. Xing
- Joseph E. Gonzalez
Venues
- OSDI 2023 ×2
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yanping-huang/