Zihao Ye
Zihao Ye has 5 papers in our library, in 2023–2025, most of them on Language models & pretraining, Efficient models & compression; often with Arvind Krishnamurthy, Lequn Chen, Baris Kasikci.
OpenAlex · ORCID · Wikidata · h-index 17 · 57 works · 2,033 citations OpenAlex, 2026-10-14
📄 5 works in our library · 🔗 Cited 574 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #3977
Affiliations
Fields, topics and concepts
📚 Shelves 10The field of science this work belongs to (OpenAlex fields).Computer Science · 5 worksArts and Humanities · 4 worksArtificial Intelligence · 4 worksLanguage and Linguistics · 4 worksHardware and Architecture · 3 worksComputer Vision and Pattern Recognition · 2 worksEngineering · 1 workComputational Theory and Mathematics · 1 workElectrical and Electronic Engineering · 1 workInformation Systems · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 4 worksEfficient models & compression · 1 work
Works by year
2020s
Papers
- FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving (2025 · 177 citations)
FlashInfer is an attention engine for LLM inference serving. It targets two problems: serving workloads keep changing, and attention variants and GPU architectures differ widely. Today each serving system ships its own narrow attention kernels, which is costly to maintain. FlashInfer replaces them with one… - Atom: Low-bit Quantization for Efficient and Accurate LLM Serving (2023 · 156 citations)
LLM serving relies on batching to keep GPUs busy, and quantization can further reduce memory use and compute cost. - Punica: Multi-Tenant LoRA Serving (2023 · 81 citations)
Organisations that fine-tune one base LLM with LoRA for many tenants usually end up running each adapter as a separate model. - NanoFlow: Towards Optimal Large Language Model Serving Throughput (2024 · 80 citations)
LLM serving is usually assumed to be limited by memory bandwidth, because every generated token requires reading the model weights and the KV-cache. - MagicPIG: LSH Sampling for Efficient LLM Generation (2024 · 68 citations)
Serving long-context LLMs is constrained by the KV cache. It consumes GPU memory and makes decoding memory-bound. Many speedups keep only the highest-scoring keys (TopK attention). The authors show this is a biased estimator that breaks down when attention is spread out, as in aggregation tasks like common- or…
All works
- FlashInfer: Efficient and Customizable Attention Engine for LLM Inference ServingMLSys 2025Zihao Ye, Lequn Chen, Ruihang Lai, et al.2025 · 177 citations
- Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
- TensorIR: An Abstraction for Automatic Tensorized Program Optimization ↗ASPLOS 2023 · no summary yetSiyuan Feng et al.2022 · 130 citations
- DGL-KE ↗International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yetDa Zheng et al.2020 · 128 citations
- Punica: Multi-Tenant LoRA ServingMLSys 2024Lequn Chen, Zihao Ye, Yongji Wu, et al.2023 · 81 citations
- NanoFlow: Towards Optimal Large Language Model Serving ThroughputOSDI 2025Kan Zhu, Yufei Gao, Yilong Zhao, et al.2024 · 80 citations
- MagicPIG: LSH Sampling for Efficient LLM GenerationarXiv:2410.16179Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.2024 · 68 citations
Co-authors here
- Arvind Krishnamurthy ×3
- Lequn Chen ×3
- Baris Kasikci ×2
- Kan Zhu ×2
- Luis Ceze ×2
- Tianqi Chen ×2
- Yilong Zhao ×2
- Beidi Chen
- Danyang Zhuo
- Leon Bottou
- Matthijs Douze
- Yang Zhou
Venues
- MLSys 2024 ×3
- ASPLOS 2023
- International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
- OSDI 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zihao-ye/