🔗 Who cites «Fast Distributed Inference Serving for Large Language Models»

101 papers of our library cite it (of the 149,439 whose bibliographies we read) · 11 with a page here, the most cited first · ← back to «Fast Distributed Inference Serving for Large Language Models»

1. DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model ServingOSDI 2024Yinmin Zhong, Shengyu Liu, Junda Chen, et al.2024 · 409 citations
2. Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
3. Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
4. Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
5. SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked PrefillsarXiv 2023Amey Agrawal, Ashish Panwar, Jayashree Mohan, et al.2023 · 144 citations
6. LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
7. Llumnix: Dynamic Scheduling for Large Language Model ServingOSDI 2024Biao Sun, Ziming Huang, Hanyu Zhao, et al.2024 · 119 citations
8. A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
9. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
10. Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
11. ServerlessLLM: Low-Latency Serverless Inference for Large Language ModelsarXiv:2401.14351Yao Fu, Leyang Xue, Yeqi Huang, et al.2024 · 105 citations

90 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/wu-2023-fast-distributed-inference-serving-large/cited-by/