🧑‍🔬 Who cites Zhao Song

289 citations of their works from 276 papers of our library (of the 149,439 whose bibliographies we read) · 45 with a page here, the most cited first · ← Zhao Song

1. A Survey on In-context LearningarXiv:2301.00234Qingxiu Dong, Lei Li, Damai Dai, et al.2023 · 978 citations
2. Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
3. KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache QuantizationConference on Neural Information Processing Systems (NeurIPS)Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.2024 · 294 citations
4. Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding HeadsarXiv:2401.10774Tianle Cai, Yuhong Li, Zhengyang Geng, et al.2024 · 278 citations
5. PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPUACM SIGOPS Symposium on Operating Systems Principles (SOSP)Yixin Song, Zeyu Mi, Haotong Xie, et al.2023 · 272 citations
6. KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV CachearXiv:2402.02750Zirui Liu, Jiayi Yuan, Hongye Jin, et al.2024 · 244 citations
7. Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferencearXiv:2406.10774Jiaming Tang, Yilong Zhao, Kan Zhu, et al.2024 · 203 citations
8. MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
9. Model Tells You What to Discard: Adaptive KV Cache Compression for LLMsarXiv:2310.01801Suyu Ge, Yunan Zhang, Liyuan Liu, et al.2023 · 202 citations
10. OmniQuant: Omnidirectionally Calibrated Quantization for Large Language ModelsarXiv:2308.13137Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.2023 · 195 citations
11. LLM in a flash: Efficient Large Language Model Inference with Limited MemoryAnnual Meeting of the Association for Computational Linguistics (ACL)Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.2024 · 193 citations
12. Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
13. Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
14. Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Jun Zhang, Jue Wang, Huan Li, et al.2024 · 148 citations
15. EAGLE-2: Faster Inference of Language Models with Dynamic Draft TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 133 citations
16. InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context MemoryConference on Neural Information Processing Systems (NeurIPS)Chaojun Xiao, Pengle Zhang, Xu Han, et al.2024 · 126 citations
17. DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
18. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
19. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
20. Prompt Cache: Modular Attention Reuse for Low-Latency InferenceMLSys 2024In Gim, Guojun Chen, Seung-seob Lee, et al.2023 · 109 citations
21. Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
22. Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityarXiv:2401.05459Yuanchun Li, Hao Wen, Weijun Wang, et al.2024 · 100 citations
23. Small Language Models are the Future of Agentic AIarXiv:2506.02153Peter Belcak, Greg Heinrich, Shizhe Diao, et al.2025 · 92 citations
24. LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
25. PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM InferenceFindings of the Association for Computational LinguisticsDongjie Yang, Xiaodong Han, Yan Gao, et al.2024 · 91 citations
26. D4: Improving LLM Pretraining via Document De-Duplication and DiversificationConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Daniel Simig, Armen Aghajanyan, et al.2023 · 81 citations
27. Punica: Multi-Tenant LoRA ServingMLSys 2024Lequn Chen, Zihao Ye, Yongji Wu, et al.2023 · 81 citations
28. S-LoRA: Serving Thousands of Concurrent LoRA AdaptersMLSys 2024Ying Sheng, Shiyi Cao, Dacheng Li, et al.2023 · 80 citations
29. The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
30. XAttention: Block Sparse Attention with Antidiagonal ScoringarXiv:2503.16428Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.2025 · 59 citations
31. From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
32. A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
33. Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zheyuan Liu, Guangyao Dou, Xiangchi Yuan, et al.2025 · 12 citations
34. Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language ModelInternational Conference on Computational Linguistics (COLING)Haoyun Xu, Runzhe Zhan, Yingpeng Ma, et al.2025 · 10 citations
35. From Storage to Experience: A Survey on the Evolution of LLM Agent Memory MechanismsFindings of the Association for Computational LinguisticsJinghao Luo, Yuchen Tian, Chuxue Cao, et al.2026 · 3 citations
36. Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMsFindings of the Association for Computational LinguisticsYiheng Yang, Yujie Wang, Chi Ma, et al.2026 · 3 citations
37. Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
38. Do LLMs Encode Functional Importance of Reasoning Tokens ?Annual Meeting of the Association for Computational Linguistics (ACL)Janvijay Singh, Dilek Hakkani-Tür2026 · 2 citations
39. Analytical FFN-to-MoE Restructuring via Activation Pattern AnalysisAnnual Meeting of the Association for Computational Linguistics (ACL)Zehua Pei, Hui-Ling Zhen, Lancheng Zou, et al.2026 · 1 citation
40. Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank SubstitutionFindings of the Association for Computational LinguisticsYuhua Zhou, Shichao Weng, Changhai Zhou, et al.2026 · 1 citation
41. Context-Conditioned Masked LoRA: Dynamic Rank Routing for Compute-Efficient Parameter-Efficient Fine-TuningFindings of the Association for Computational LinguisticsRifat Rafiuddin, Rafae Abdullah2026
42. Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache CompressionAnnual Meeting of the Association for Computational Linguistics (ACL)Liang Zhao, Xiaocheng Feng, Weihong Zhong, et al.2026
43. RoBSA: RoPE-based Blockwise Sparse Multi-head Latent AttentionAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Shi, Kairong Luo, Zhen Zheng, et al.2026
44. SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language ModelsJoint Conference on Lexical and Computational Semantics (*SEM)Dong Liu, Yanxuan Yu2026
45. ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)David H. Yang, Yuxuan Zhu, Mohammad Mohammadi Amiri, et al.2026

231 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhao-song/cited-by/