Who cites Shengyu Liu
- HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model ServingOSDI 2024Yinmin Zhong, Shengyu Liu, Junda Chen, et al.2024 · 409 citations
- Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
- Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
- Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
- SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked PrefillsarXiv 2023Amey Agrawal, Ashish Panwar, Jayashree Mohan, et al.2023 · 144 citations
- LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
- Fast Distributed Inference Serving for Large Language ModelsarXiv 2023Bingyang Wu, Yinmin Zhong, Zili Zhang, et al.2023 · 123 citations
- Llumnix: Dynamic Scheduling for Large Language Model ServingOSDI 2024Biao Sun, Ziming Huang, Hanyu Zhao, et al.2024 · 119 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
- ServerlessLLM: Low-Latency Serverless Inference for Large Language ModelsarXiv:2401.14351Yao Fu, Leyang Xue, Yeqi Huang, et al.2024 · 105 citations
- Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
- Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI ArchitecturesProceedings - International Symposium on Computer Architecture/ProceedingsChenggang Zhao, Chengqi Deng, Chong Ruan, et al.2025 · 74 citations
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector RetrievalConference on Neural Information Processing Systems (NeurIPS)Di Liu, Meng Chen, Baotong Lu, et al.2024 · 66 citations
- A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
- From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
- Step-3 is Large yet Affordable: Model-system Co-design for Cost-effective DecodingarXiv:2507.19427StepFun, Bin Wang, Bojun Wang, et al.2025 · 26 citations
- PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Zhang, Lyu Mengsi, Zhuo Chen, et al.2026 · 6 citations
- Beyond Accuracy: Unveiling Inefficiency Patterns in Tool-Integrated ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Qisheng Su, Shiting Huang, Zhen Fang, et al.2026 · 2 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shengyu-liu/cited-by/