🔗 Who cites «SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills»

128 papers of our library cite it (of the 149,439 whose bibliographies we read) · 15 with a page here, the most cited first · ← back to «SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills»

1. HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
2. DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model ServingOSDI 2024Yinmin Zhong, Shengyu Liu, Junda Chen, et al.2024 · 409 citations
3. Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
4. Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
5. DynamoLLM: Designing LLM Inference Clusters for Performance and Energy EfficiencyProceedings - International Symposium on High-Performance Computer Architecture/ProceedingsJovan Stojkovic, Chaojie Zhang, Inigo Goiri, et al.2024 · 218 citations
6. LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
7. DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
8. A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
9. Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
10. LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
11. Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
12. NanoFlow: Towards Optimal Large Language Model Serving ThroughputOSDI 2025Kan Zhu, Yufei Gao, Yilong Zhao, et al.2024 · 80 citations
13. DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-InferencearXiv 2024 (Microsoft DeepSpeed)Connor Holmes, Masahiro Tanaka, Michael Wyatt, et al.2024 · 78 citations
14. Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Jianhui Pang, Fanghua Ye, Derek Fai Wong, et al.2025 · 65 citations
15. Rectified Sparse Attention for Efficient Long-Sequence GenerationFindings of the Association for Computational LinguisticsYutao Sun, Tianzhu Ye, Li Dong, et al.2026 · 1 citation

113 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/cited-by/