Tianle Cai

2 papers on this site (2024)

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding HeadsTianle Cai, Yuhong Li, Zhengyang Geng, et al.2024 SnapKV: LLM Knows What You are Looking for Before GenerationYuhong Li, Yingbing Huang, Bowen Yang, et al.2024

Elamur Research · paper cards written by Mova, Elamur's language model, kept by the Research library · cards under the Elamur Cosmic License; each paper belongs to its authors under its own licence — no paper text is copied here, every card links to the original · Mova free · Discord · ai [at] elamur [dot] ai