🔗 Who cites «H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models»

124 papers of our library cite it (of the 149,439 whose bibliographies we read) · 25 with a page here, the most cited first · ← back to «H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models»

1. KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache QuantizationConference on Neural Information Processing Systems (NeurIPS)Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.2024 · 294 citations
2. Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding HeadsarXiv:2401.10774Tianle Cai, Yuhong Li, Zhengyang Geng, et al.2024 · 278 citations
3. KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV CachearXiv:2402.02750Zirui Liu, Jiayi Yuan, Hongye Jin, et al.2024 · 244 citations
4. Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferencearXiv:2406.10774Jiaming Tang, Yilong Zhao, Kan Zhu, et al.2024 · 203 citations
5. Model Tells You What to Discard: Adaptive KV Cache Compression for LLMsarXiv:2310.01801Suyu Ge, Yunan Zhang, Liyuan Liu, et al.2023 · 202 citations
6. Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
7. Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
8. InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context MemoryConference on Neural Information Processing Systems (NeurIPS)Chaojun Xiao, Pengle Zhang, Xu Han, et al.2024 · 126 citations
9. DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
10. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
11. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
12. Prompt Cache: Modular Attention Reuse for Low-Latency InferenceMLSys 2024In Gim, Guojun Chen, Seung-seob Lee, et al.2023 · 109 citations
13. Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
14. Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityarXiv:2401.05459Yuanchun Li, Hao Wen, Weijun Wang, et al.2024 · 100 citations
15. PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM InferenceFindings of the Association for Computational LinguisticsDongjie Yang, Xiaodong Han, Yan Gao, et al.2024 · 91 citations
16. Punica: Multi-Tenant LoRA ServingMLSys 2024Lequn Chen, Zihao Ye, Yongji Wu, et al.2023 · 81 citations
17. S-LoRA: Serving Thousands of Concurrent LoRA AdaptersMLSys 2024Ying Sheng, Shiyi Cao, Dacheng Li, et al.2023 · 80 citations
18. XAttention: Block Sparse Attention with Antidiagonal ScoringarXiv:2503.16428Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.2025 · 59 citations
19. From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
20. From Storage to Experience: A Survey on the Evolution of LLM Agent Memory MechanismsFindings of the Association for Computational LinguisticsJinghao Luo, Yuchen Tian, Chuxue Cao, et al.2026 · 3 citations
21. Do LLMs Encode Functional Importance of Reasoning Tokens ?Annual Meeting of the Association for Computational Linguistics (ACL)Janvijay Singh, Dilek Hakkani-Tür2026 · 2 citations
22. Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache CompressionAnnual Meeting of the Association for Computational Linguistics (ACL)Liang Zhao, Xiaocheng Feng, Weihong Zhong, et al.2026
23. RoBSA: RoPE-based Blockwise Sparse Multi-head Latent AttentionAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Shi, Kairong Luo, Zhen Zheng, et al.2026
24. SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language ModelsJoint Conference on Lexical and Computational Semantics (*SEM)Dong Liu, Yanxuan Yu2026
25. ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)David H. Yang, Yuxuan Zhu, Mohammad Mohammadi Amiri, et al.2026

99 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/cited-by/