Who cites «Online Speculative Decoding»
- On-Policy Distillation of Language Models: Learning from Self-Generated MistakesarXiv:2306.13649Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, et al.2023 · 299 citations
- EAGLE: Speculative Sampling Requires Rethinking Feature UncertaintyarXiv:2401.15077Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 208 citations
- Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative DecodingFindings of the Association for Computational LinguisticsHeming Xia, Zhe Yang, Qingxiu Dong, et al.2024 · 146 citations
- EAGLE-2: Faster Inference of Language Models with Dynamic Draft TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 133 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
- Rephrasing the Web: A Recipe for Compute and Data-Efficient Language ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Pratyush Maini, Skyler Seto, Richard Bai, et al.2024 · 90 citations
- Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved SamplingarXiv:2410.11325Wenda Xu, Rujun Han, Zifeng Wang, et al.2024 · 41 citations
- MambaByte: Token-free Selective State Space ModelarXiv:2401.13660Junxiong Wang, Tushaar Gangavarapu, Jing Nathan Yan, et al.2024 · 35 citations
- Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token RecyclingAnnual Meeting of the Association for Computational Linguistics (ACL)Xianzhen Luo, Yixuan Wang, Qingfu Zhu, et al.2025 · 22 citations
- SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative DecodingInternational Conference on Computational Linguistics (COLING)Zhenglin Wang, Jialong Wu, Yilong Lai, et al.2025 · 8 citations
- LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and VerificationAnnual Meeting of the Association for Computational Linguistics (ACL)Penghui Yang, Cunxiao Du, Fengzhuo Zhang, et al.2026 · 5 citations
- MARS: Unleashing the Power of Speculative Decoding via Margin-Aware VerificationFindings of the Association for Computational LinguisticsJingwei Song, Xinyu Wang, Hanbin Wang, et al.2026
- Measuring Distribution Shift in User Prompts and Its Effects on LLM PerformanceAnnual Meeting of the Association for Computational Linguistics (ACL)Parker Seegmiller, Sarah Masud Preum2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2023-online-speculative-decoding/cited-by/