Kan Zhu
Kan Zhu has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining, Efficient models & compression; often with Yilong Zhao, Baris Kasikci, Zihao Ye.
OpenAlex · h-index 12 · 26 works · 617 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 433 times in our library · 3 more in our library without a page yet · ⭐ Paper Stars ranking: #4586
Affiliations
Fields, topics and concepts
📚 Shelves 9The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArts and Humanities · 2 worksComputer Vision and Pattern Recognition · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksEngineering · 1 workComputational Theory and Mathematics · 1 workElectrical and Electronic Engineering · 1 workHardware and Architecture · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 3 worksEfficient models & compression · 1 work
Works by year
2020s
Papers
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference (2024 · 203 citations)
Generating text with very long contexts is slow because every new token requires reading the full KV cache from memory. - Atom: Low-bit Quantization for Efficient and Accurate LLM Serving (2023 · 156 citations)
LLM serving relies on batching to keep GPUs busy, and quantization can further reduce memory use and compute cost. - NanoFlow: Towards Optimal Large Language Model Serving Throughput (2024 · 80 citations)
LLM serving is usually assumed to be limited by memory bandwidth, because every generated token requires reading the model weights and the KV-cache.
All works
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferencearXiv:2406.10774Jiaming Tang, Yilong Zhao, Kan Zhu, et al.2024 · 203 citations
- Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
- NanoFlow: Towards Optimal Large Language Model Serving ThroughputOSDI 2025Kan Zhu, Yufei Gao, Yilong Zhao, et al.2024 · 80 citations
- BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching ↗arXiv (Cornell University) · no summary yetYilong Zhao et al.2024 · 16 citations
- BlendServe: Optimizing Offline Inference with Resource-Aware Batching ↗ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · no summary yetYilong Zhao et al.2026 · 2 citations
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding ↗arXiv:2512.01278 · no summary yetYilong Zhao et al.2025 · 2 citations
Co-authors here
- Yilong Zhao ×3
- Baris Kasikci ×2
- Zihao Ye ×2
- Arvind Krishnamurthy
- Guangxuan Xiao
- Jiaming Tang
- Lequn Chen
- Luis Ceze
- Song Han
- Tianqi Chen
Venues
- ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
- MLSys 2024
- OSDI 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/kan-zhu/