Xin Jin
Xin Jin has 5 papers in our library, in 2023–2024, most of them on Language models & pretraining, GPU & parallel computing; often with Yinmin Zhong, Shengyu Liu, Xuanzhe Liu.
OpenAlex · ORCID · Wikidata · h-index 27 · 129 works · 2,123 citations OpenAlex, 2026-10-14
📄 5 works in our library · 🔗 Cited 781 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #2910
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 5 worksHardware and Architecture · 5 worksArts and Humanities · 2 worksInformation Systems · 3 worksComputer Networks and Communications · 3 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 3 worksGPU & parallel computing · 1 work
Works by year
2020s
Papers
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving (2024 · 409 citations)
LLM inference has two phases with different profiles. Prefill processes the whole prompt in one compute-heavy step. Decoding emits one token per step and is bound by memory bandwidth. Mainstream systems batch both phases on the same GPUs. As a result, prefill delays inflate TPOT, decoding work inflates TTFT, and both… - AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (2023 · 170 citations)
AlpaServe asks how to serve many large deep learning models on a shared GPU cluster when request traffic is highly bursty. - LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism (2024 · 131 citations)
Long-context LLMs (Claude-3, Gemini-1.5 and LWM all accept up to 1M tokens) create very uneven resource demands. - Fast Distributed Inference Serving for Large Language Models (2023 · 123 citations)
FastServe, from Peking University, is a distributed serving system for large language models that targets the latency of interactive applications. - FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion (2024 · 67 citations)
Tensor parallelism splits individual layers of large models across GPUs. This lowers latency, but it adds AllGather and ReduceScatter traffic that can take a large share of runtime. Earlier overlap schemes, such as TransformerEngine, cut a GEMM and its collective into a few chunks, one per device, and schedule them…
All works
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model ServingOSDI 2024Yinmin Zhong, Shengyu Liu, Junda Chen, et al.2024 · 409 citations
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning ServingOSDI 2023Zhuohan Li, Lianmin Zheng, Yinmin Zhong, et al.2023 · 170 citations
- LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
- Fast Distributed Inference Serving for Large Language ModelsarXiv 2023Bingyang Wu, Yinmin Zhong, Zili Zhang, et al.2023 · 123 citations
- FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel FusionarXiv:2406.06858Li-Wen Chang, Wenlei Bao, Qi Hou, et al.2024 · 67 citations
- RackSched: A Microsecond-Scale Scheduler for Rack-Scale Computers (Technical Report) ↗arXiv (Cornell University) · no summary yetHang Zhu et al.2020
- NetChain: Scale-Free Sub-RTT Coordination (Extended Version) ↗arXiv (Cornell University) · no summary yetXin Jin et al.2018
Co-authors here
- Yinmin Zhong ×5
- Shengyu Liu ×3
- Xuanzhe Liu ×3
- Bingyang Wu ×2
- Hao Zhang ×2
- Chengquan Jiang
- Haibin Lin
- Joseph E. Gonzalez
- Lianmin Zheng
- Peng Sun
- Yanping Huang
- Yibo Zhu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/xin-jin/