Who cites «DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference»
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
- LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
- LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
- Chat-Ghosting: Methods for Auto-Completion in Dialog SystemsConference of the European Chapter of the Association for Computational Linguistics (EACL)Anubhab Mandal, Sandeep Mishra, Bishal Santra, et al.2026 · 1 citation
- Rectified Sparse Attention for Efficient Long-Sequence GenerationFindings of the Association for Computational LinguisticsYutao Sun, Tianzhu Ye, Li Dong, et al.2026 · 1 citation
This page in Markdown → https://md.research.elamur.ai/free/en/papers/holmes-2024-deepspeed-fastgen-high-throughput-text/cited-by/