Who cites «Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time»
- A Survey on In-context LearningarXiv:2301.00234Qingxiu Dong, Lei Li, Damai Dai, et al.2023 · 978 citations
- Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
- PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPUACM SIGOPS Symposium on Operating Systems Principles (SOSP)Yixin Song, Zeyu Mi, Haotong Xie, et al.2023 · 272 citations
- MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMsarXiv:2310.01801Suyu Ge, Yunan Zhang, Liyuan Liu, et al.2023 · 202 citations
- OmniQuant: Omnidirectionally Calibrated Quantization for Large Language ModelsarXiv:2308.13137Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.2023 · 195 citations
- LLM in a flash: Efficient Large Language Model Inference with Limited MemoryAnnual Meeting of the Association for Computational Linguistics (ACL)Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.2024 · 193 citations
- Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Jun Zhang, Jue Wang, Huan Li, et al.2024 · 148 citations
- EAGLE-2: Faster Inference of Language Models with Dynamic Draft TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 133 citations
- Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
- Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityarXiv:2401.05459Yuanchun Li, Hao Wen, Weijun Wang, et al.2024 · 100 citations
- Small Language Models are the Future of Agentic AIarXiv:2506.02153Peter Belcak, Greg Heinrich, Shizhe Diao, et al.2025 · 92 citations
- LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
- D4: Improving LLM Pretraining via Document De-Duplication and DiversificationConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Daniel Simig, Armen Aghajanyan, et al.2023 · 81 citations
- Punica: Multi-Tenant LoRA ServingMLSys 2024Lequn Chen, Zihao Ye, Yongji Wu, et al.2023 · 81 citations
- The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
- A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
- Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zheyuan Liu, Guangyao Dou, Xiangchi Yuan, et al.2025 · 12 citations
- Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language ModelInternational Conference on Computational Linguistics (COLING)Haoyun Xu, Runzhe Zhan, Yingpeng Ma, et al.2025 · 10 citations
- Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMsFindings of the Association for Computational LinguisticsYiheng Yang, Yujie Wang, Chi Ma, et al.2026 · 3 citations
- Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
- Analytical FFN-to-MoE Restructuring via Activation Pattern AnalysisAnnual Meeting of the Association for Computational Linguistics (ACL)Zehua Pei, Hui-Ling Zhen, Lancheng Zou, et al.2026 · 1 citation
- Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank SubstitutionFindings of the Association for Computational LinguisticsYuhua Zhou, Shichao Weng, Changhai Zhou, et al.2026 · 1 citation
This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2023-deja-vu-contextual-sparsity-efficient/cited-by/