🔗 Who cites «DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving»

394 papers of our library cite it (of the 149,439 whose bibliographies we read) · 16 with a page here, the most cited first · ← back to «DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving»

1. HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
2. Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
3. Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
4. Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
5. LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
6. Fast Distributed Inference Serving for Large Language ModelsarXiv 2023Bingyang Wu, Yinmin Zhong, Zili Zhang, et al.2023 · 123 citations
7. A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
8. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
9. Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
10. Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI ArchitecturesProceedings - International Symposium on Computer Architecture/ProceedingsChenggang Zhao, Chengqi Deng, Chong Ruan, et al.2025 · 74 citations
11. RetrievalAttention: Accelerating Long-Context LLM Inference via Vector RetrievalConference on Neural Information Processing Systems (NeurIPS)Di Liu, Meng Chen, Baotong Lu, et al.2024 · 66 citations
12. A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
13. From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
14. Step-3 is Large yet Affordable: Model-system Co-design for Cost-effective DecodingarXiv:2507.19427StepFun, Bin Wang, Bojun Wang, et al.2025 · 26 citations
15. PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Zhang, Lyu Mengsi, Zhuo Chen, et al.2026 · 6 citations
16. Beyond Accuracy: Unveiling Inefficiency Patterns in Tool-Integrated ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Qisheng Su, Shiting Huang, Zhen Fang, et al.2026 · 2 citations

378 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/zhong-2024-distserve-disaggregating-prefill-decoding-goodput/cited-by/