Who cites Nipun Kwatra
- HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model ServingOSDI 2024Yinmin Zhong, Shengyu Liu, Junda Chen, et al.2024 · 409 citations
- Splitwise: Efficient generative LLM inference using phase splittingISCA 2024Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.2023 · 379 citations
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
- DynamoLLM: Designing LLM Inference Clusters for Performance and Energy EfficiencyProceedings - International Symposium on High-Performance Computer Architecture/ProceedingsJovan Stojkovic, Chaojie Zhang, Inigo Goiri, et al.2024 · 218 citations
- FlashInfer: Efficient and Customizable Attention Engine for LLM Inference ServingMLSys 2025Zihao Ye, Lequn Chen, Ruihang Lai, et al.2025 · 177 citations
- Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
- Atom: Low-bit Quantization for Efficient and Accurate LLM ServingMLSys 2024Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.2023 · 156 citations
- LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence ParallelismACM SIGOPS Symposium on Operating Systems Principles (SOSP)Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.2024 · 131 citations
- DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
- LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
- Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
- NanoFlow: Towards Optimal Large Language Model Serving ThroughputOSDI 2025Kan Zhu, Yufei Gao, Yilong Zhao, et al.2024 · 80 citations
- DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-InferencearXiv 2024 (Microsoft DeepSpeed)Connor Holmes, Masahiro Tanaka, Michael Wyatt, et al.2024 · 78 citations
- Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Jianhui Pang, Fanghua Ye, Derek Fai Wong, et al.2025 · 65 citations
- Learning from Diverse Reasoning Paths with Routing and CollaborationConference on Empirical Methods in Natural Language Processing (EMNLP)Zhenyu Lei, Zhen Tan, Song Wang, et al.2025 · 11 citations
- Rectified Sparse Attention for Efficient Long-Sequence GenerationFindings of the Association for Computational LinguisticsYutao Sun, Tianzhu Ye, Li Dong, et al.2026 · 1 citation
- CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent SimulationsFindings of the Association for Computational LinguisticsXiangning Yu, Yuwei Guo, Yuqi Hou, et al.2026
- QUARTZ: Quantile-Aware Routing and Queueing for TTFT SLOs in LLM ServingFindings of the Association for Computational LinguisticsZhipeng Liu, Yifan Zheng, Fanqi Kong, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/nipun-kwatra/cited-by/