Yilong Zhao
Yilong Zhao has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining, Efficient models & compression; often with Kan Zhu, Baris Kasikci, Zihao Ye.
OpenAlex · ORCID · h-index 8 · 41 works · 195 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 543 times in our library · 7 more in our library without a page yet · ⭐ Paper Stars ranking: #4588
Affiliations
Fields, topics and concepts
📚 Shelves 9The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArts and Humanities · 2 worksComputer Vision and Pattern Recognition · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksEngineering · 1 workComputational Theory and Mathematics · 1 workElectrical and Electronic Engineering · 1 workHardware and Architecture · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 3 worksEfficient models & compression · 1 work
Works by year
2020s
Papers
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference (2024 · 203 citations)
Generating text with very long contexts is slow because every new token requires reading the full KV cache from memory. - Atom: Low-bit Quantization for Efficient and Accurate LLM Serving (2023 · 156 citations)
LLM serving relies on batching to keep GPUs busy, and quantization can further reduce memory use and compute cost. - NanoFlow: Towards Optimal Large Language Model Serving Throughput (2024 · 80 citations)
LLM serving is usually assumed to be limited by memory bandwidth, because every generated token requires reading the model weights and the KV-cache.
All works
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferencearXiv:2406.10774Jiaming Tang, Yilong Zhao, Kan Zhu, et al.2024 · 203 citations
- Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
- NanoFlow: Towards Optimal Large Language Model Serving ThroughputOSDI 2025Kan Zhu, Yufei Gao, Yilong Zhao, et al.2024 · 80 citations
- Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity ↗arXiv:2502.01776 · no summary yetHaocheng Xi et al.2025 · 56 citations
- Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation ↗arXiv:2505.18875 · no summary yetShuo Yang et al.2025 · 44 citations
- BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching ↗arXiv (Cornell University) · no summary yetYilong Zhao et al.2024 · 16 citations
- An Extensible Software Transport Layer for GPU Networking ↗arXiv:2504.17307 · no summary yetYang Zhou et al.2025 · 10 citations
- BlendServe: Optimizing Offline Inference with Resource-Aware Batching ↗ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · no summary yetYilong Zhao et al.2026 · 2 citations
- LEANN: A Low-Storage Vector Index ↗arXiv (Cornell University) · no summary yetYichuan Wang et al.2025 · 2 citations
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding ↗arXiv:2512.01278 · no summary yetYilong Zhao et al.2025 · 2 citations
Co-authors here
- Kan Zhu ×3
- Baris Kasikci ×2
- Zihao Ye ×2
- Arvind Krishnamurthy
- Guangxuan Xiao
- Jiaming Tang
- Lequn Chen
- Luis Ceze
- Song Han
- Tianqi Chen
Venues
- ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
- MLSys 2024
- OSDI 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yilong-zhao/