🔗 Who cites «Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve»

354 papers of our library cite it (of the 149,439 whose bibliographies we read) · 9 with a page here, the most cited first · ← back to «Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve»

1. FlashInfer: Efficient and Customizable Attention Engine for LLM Inference ServingMLSys 2025Zihao Ye, Lequn Chen, Ruihang Lai, et al.2025 · 177 citations
2. Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
3. Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
4. A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
5. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
6. Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
7. NanoFlow: Towards Optimal Large Language Model Serving ThroughputOSDI 2025Kan Zhu, Yufei Gao, Yilong Zhao, et al.2024 · 80 citations
8. Learning from Diverse Reasoning Paths with Routing and CollaborationConference on Empirical Methods in Natural Language Processing (EMNLP)Zhenyu Lei, Zhen Tan, Song Wang, et al.2025 · 11 citations
9. QUARTZ: Quantile-Aware Routing and Queueing for TTFT SLOs in LLM ServingFindings of the Association for Computational LinguisticsZhipeng Liu, Yifan Zheng, Fanqi Kong, et al.2026

345 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/agrawal-2024-taming-throughput-latency-tradeoff-llm/cited-by/