Wencong Xiao
Wencong Xiao has 2 papers in our library, in 2019–2024, most of them on Language models & pretraining, GPU & parallel computing, Efficient models & compression; often with Amar Phanishayee, Fan Yang, Shivaram Venkataraman.
OpenAlex · ORCID · Wikidata · h-index 13 · 38 works · 1,122 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 253 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #5569
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksComputer Networks and Communications · 2 worksInformation Systems · 2 worksHardware and Architecture · 1 work
🧭 Topics 3Research subjects and languages the work is about.GPU & parallel computing · 1 workEfficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
2010s
Papers
- Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads (2019 · 179 citations)
The paper examines how deep learning training behaves on a shared, production GPU cluster at Microsoft. Such clusters differ from classic big-data clusters in two ways: a GPU cannot easily be split among users, and multi-GPU jobs must have all their GPUs allocated at once (gang scheduling). The authors describe… - Llumnix: Dynamic Scheduling for Large Language Model Serving (2024 · 119 citations)
Requests to a served LLM vary widely in prompt length, output length and latency needs. Neither their run time nor their KV-cache memory growth is known in advance. Dispatching each request once, with policies inherited from classic DNN serving, therefore causes preemptions, queuing delays, memory fragmentation…
All works
- Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training WorkloadsarXiv:1901.05758Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, et al.2019 · 179 citations
- Llumnix: Dynamic Scheduling for Large Language Model ServingOSDI 2024Biao Sun, Ziming Huang, Hanyu Zhao, et al.2024 · 119 citations
- Balanced Sparsity for Efficient DNN Inference on GPU ↗arXiv:1811.00206 · no summary yetZhuliang Yao et al.2018 · 102 citations
- SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetShi‐Jie Cao et al.2019 · 77 citations
Co-authors here
Venues
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- OSDI 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/wencong-xiao/