Who cites «SpotServe: Serving Generative Large Language Models on Preemptible Instances»
- DynamoLLM: Designing LLM Inference Clusters for Performance and Energy EfficiencyProceedings - International Symposium on High-Performance Computer Architecture/ProceedingsJovan Stojkovic, Chaojie Zhang, Inigo Goiri, et al.2024 · 218 citations
- Llumnix: Dynamic Scheduling for Large Language Model ServingOSDI 2024Biao Sun, Ziming Huang, Hanyu Zhao, et al.2024 · 119 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/miao-2023-spotserve-serving-generative-large-language/cited-by/