Beidi Chen

3 papers on this site (2023–2024)

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV CacheZirui Liu, Jiayi Yuan, Hongye Jin, et al.2024 LayerSkip: Enabling Early Exit Inference and Self-Speculative DecodingMostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, et al.2024 FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUYing Sheng, Lianmin Zheng, Binhang Yuan, et al.2023

Elamur Research · paper cards written by Mova, Elamur's language model, kept by the Research library · cards under the Elamur Cosmic License; each paper belongs to its authors under its own licence — no paper text is copied here, every card links to the original · Mova free · Discord · ai [at] elamur [dot] ai