Yinmin Zhong
Yinmin Zhong has 6 papers in our library, in 2023–2024, most of them on Language models & pretraining, GPU & parallel computing; often with Xin Jin, Shengyu Liu, Xuanzhe Liu.
OpenAlex · ORCID · h-index 8 · 26 works · 240 citations OpenAlex, 2026-10-14
📄 6 works in our library · 🔗 Cited 1,379 times in our library · ⭐ Paper Stars ranking: #2609
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 6 worksHardware and Architecture · 6 worksArts and Humanities · 3 worksInformation Systems · 4 worksComputer Networks and Communications · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 4 worksGPU & parallel computing · 2 works
Works by year
2020s
Papers
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving (2024 · 409 citations)
LLM inference has two phases with different profiles. Prefill processes the whole prompt in one compute-heavy step. Decoding emits one token per step and is bound by memory bandwidth. Mainstream systems batch both phases on the same GPUs. As a result, prefill delays inflate TPOT, decoding work inflates TTFT, and both… - AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (2023 · 170 citations)
AlpaServe asks how to serve many large deep learning models on a shared GPU cluster when request traffic is highly bursty. - MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs (2024 · 157 citations)
When an LLM training job takes over a whole cluster of tens of thousands of GPUs, two engineering problems dominate. - LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism (2024 · 131 citations)
Long-context LLMs (Claude-3, Gemini-1.5 and LWM all accept up to 1M tokens) create very uneven resource demands. - Fast Distributed Inference Serving for Large Language Models (2023 · 123 citations)
FastServe, from Peking University, is a distributed serving system for large language models that targets the latency of interactive applications. - FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion (2024 · 67 citations)
Tensor parallelism splits individual layers of large models across GPUs. This lowers latency, but it adds AllGather and ReduceScatter traffic that can take a large share of runtime. Earlier overlap schemes, such as TransformerEngine, cut a GEMM and its collective into a few chunks, one per device, and schedule them…
Co-authors here
- Xin Jin ×5
- Shengyu Liu ×3
- Xuanzhe Liu ×3
- Bingyang Wu ×2
- Haibin Lin ×2
- Hao Zhang ×2
- Ziheng Jiang ×2
- Chengquan Jiang
- Joseph E. Gonzalez
- Lianmin Zheng
- Peng Sun
- Xiang Li
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yinmin-zhong/