Who cites «AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving»
- HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model ServingOSDI 2024Yinmin Zhong, Shengyu Liu, Junda Chen, et al.2024 · 409 citations
- Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
- DynamoLLM: Designing LLM Inference Clusters for Performance and Energy EfficiencyProceedings - International Symposium on High-Performance Computer Architecture/ProceedingsJovan Stojkovic, Chaojie Zhang, Inigo Goiri, et al.2024 · 218 citations
- LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
- Fast Distributed Inference Serving for Large Language ModelsarXiv 2023Bingyang Wu, Yinmin Zhong, Zili Zhang, et al.2023 · 123 citations
- Llumnix: Dynamic Scheduling for Large Language Model ServingOSDI 2024Biao Sun, Ziming Huang, Hanyu Zhao, et al.2024 · 119 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- ServerlessLLM: Low-Latency Serverless Inference for Large Language ModelsarXiv:2401.14351Yao Fu, Leyang Xue, Yeqi Huang, et al.2024 · 105 citations
- S-LoRA: Serving Thousands of Concurrent LoRA AdaptersMLSys 2024Ying Sheng, Shiyi Cao, Dacheng Li, et al.2023 · 80 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/li-2023-alpaserve-statistical-multiplexing-model-parallelism/cited-by/