Zirui Liu
Zirui Liu has 3 papers in our library, in 2024, most of them on Language models & pretraining, Low-resource languages, Efficient models & compression; often with Hongye Jin, Xia Hu, Beidi Chen.
OpenAlex · ORCID · Wikidata · h-index 24 · 141 works · 2,465 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 355 citations in our library · ⭐ Paper Star rank #3679
Affiliations
Concepts, shelves and topics
📚 Shelves 6 Arts and Humanities · 3 works Computer Science · 3 works Artificial Intelligence · 3 works Language and Linguistics · 3 works Computer Vision and Pattern Recognition · 1 work Hardware and Architecture · 1 work
🧭 Topics 3 Efficient models & compression · 1 work Language models & pretraining · 2 works Low-resource languages · 1 work
Works by year
2020s
Papers
- KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache (2024 · 243 citations)
Serving LLMs cheaply means batching many requests. With large batches and long contexts, though, the KV cache becomes the main memory and speed bottleneck: it can exceed the size of the model weights, and the GPU must read it in full for every generated token. The authors examine how values are distributed inside the… - Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languages (2024 · 95 citations)
LLMs are trained on corpora dominated by English. For example, about 92.65% of GPT-3 tokens and 89.7% of LlaMa2 pre-training data are English. As a result, low-resource languages get weaker support, yet there are few quantitative ways to measure this gap. The authors propose Language Ranker, an intrinsic metric that… - LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning (2024 · 78 citations)
Large language models that use RoPE usually fail on inputs longer than their pretraining sequence length. Perplexity spikes and outputs become erratic. In this ICML 2024 paper, the authors argue that the problem is not a lack of long-text understanding. Instead, they blame a "positional O.O.D." effect: at inference…
Co-authors here
- Hongye Jin ×2
- Xia Hu ×2
- Beidi Chen
- Fan Yang
- Jiayi Yuan
- Jingfeng Yang
- Mengnan Du
- Ninghao Liu
- Shaochen Zhong
- Xiaotian Han
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zirui-liu/