Danyang Zhuo
Danyang Zhuo has 2 papers in our library, in 2022–2023; often with Arvind Krishnamurthy, Eric P. Xing, Hao Zhang.
OpenAlex · ORCID · Wikidata · h-index 12 · 80 works · 660 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 420 times in our library · 7 more in our library without a page yet · ⭐ Paper Stars ranking: #5105
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksHardware and Architecture · 2 worksComputer Networks and Communications · 1 workComputer Vision and Pattern Recognition · 1 workArts and Humanities · 1 workArtificial Intelligence · 1 workInformation Systems · 1 workLanguage and Linguistics · 1 work
Works by year
2020s
Papers
- Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning (2022 · 279 citations)
Training models with billions of parameters requires combining data, operator and pipeline parallelism. Until now, engineers either designed that combination by hand for a specific model and cluster, as with Megatron-LM's "3D parallelism", or used automatic tools that search only one kind of parallelism. Alpa takes a… - Punica: Multi-Tenant LoRA Serving (2023 · 81 citations)
Organisations that fine-tune one base LLM with LoRA for many tenants usually end up running each adapter as a separate model.
All works
- Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep LearningOSDI 2022Lianmin Zheng, Zhuohan Li, Hao Zhang, et al.2022 · 279 citations
- Ansor: Generating High-Performance Tensor Programs for Deep Learning ↗arXiv:2006.06762 · no summary yetLianmin Zheng et al.2020 · 130 citations
- TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models ↗arXiv (Cornell University) · no summary yetZhuohan Li et al.2021 · 90 citations
- Punica: Multi-Tenant LoRA ServingMLSys 2024Lequn Chen, Zihao Ye, Yongji Wu, et al.2023 · 81 citations
- Fairness in Serving Large Language Models ↗arXiv (Cornell University) · no summary yetYing Sheng et al.2023 · 62 citations
- HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs ↗arXiv:2504.03871 · no summary yetYongji Wu et al.2025 · 10 citations
- Rearchitecting in-memory object stores for low latency ↗Proceedings of the VLDB Endowment · no summary yetDanyang Zhuo et al.2021 · 7 citations
- Foundry: Template-Based CUDA Graph Context Materialization for Fast LLM Serving Cold Start ↗arXiv:2604.06664 · no summary yetXueshen Liu et al.2026 · 2 citations
- Hoplite: Efficient Collective Communication for Task-Based Distributed Systems. ↗arXiv (Cornell University) · no summary yetSiyuan Zhuang et al.2020
Co-authors here
- Arvind Krishnamurthy
- Eric P. Xing
- Hao Zhang
- Lequn Chen
- Lianmin Zheng
- Luis Ceze
- Yanping Huang
- Yonghao Zhuang
- Yuanzhong Xu
- Zhifeng Chen
- Zhuohan Li
- Zihao Ye
Venues
- MLSys 2024
- OSDI 2022
- Proceedings of the VLDB Endowment
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/danyang-zhuo/