Who cites «QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving»
- DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
- EfficientQAT: Efficient Quantization-Aware Training for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhao Chen, Wenqi Shao, Peng Xu, et al.2025 · 82 citations
- SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
- MagicPIG: LSH Sampling for Efficient LLM GenerationarXiv:2410.16179Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.2024 · 68 citations
- XAttention: Block Sparse Attention with Antidiagonal ScoringarXiv:2503.16428Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.2025 · 59 citations
- From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
- “Give Me BF16 or Give Me Death”? Accuracy-Performance Trade-Offs in LLM QuantizationAnnual Meeting of the Association for Computational Linguistics (ACL)Eldar Kurtic, Alexandre Noll Marques, Shubhra Pandit, et al.2025 · 21 citations
- ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoqian Meng, Yilun Luo, Yafei Zhao, et al.2026 · 5 citations
- MixKVQ: Query-Aware Mixed-Precision KV Cache Quantization for Long-Context ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Tao Zhang, Ziqian Zeng, Hao Peng, et al.2026 · 5 citations
- SharVeT: Similarity-aware Parameter Sharing with Vector-based Tuning for Efficient LLM CompressionAnnual Meeting of the Association for Computational Linguistics (ACL)Jeongin Yun, Jaeri Lee, Jongjin Kim, et al.2026 · 1 citation
- ACBQ: Adaptive Cross-Block Quantization of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hailing Wang, Jianglin Lu, Yitian Zhang, et al.2026
- RRAtention: Dynamic Block Sparse Attention via Per-Head Round-Robin Shifts for Long-Context InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Siran Liu, Guoxia Wang, Sa Wang, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/lin-2024-qserve-w4a8kv4-quantization-system-co/cited-by/