Zhenhua Han
Zhenhua Han has 2 papers in our library, in 2024, most of them on Language models & pretraining, Information retrieval & search; often with Chengruidong Zhang, Huiqiang Jiang, Chen Chen.
OpenAlex · ORCID · Wikidata · h-index 18 · 65 works · 1,283 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 230 times in our library · ⭐ Paper Stars ranking: #5809
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksInformation retrieval & search · 1 work
Works by year
2020s
Papers
- MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention (2024 · 202 citations)
Long-context LLMs face a serious delay before they produce their first token. During pre-filling, attention cost grows quadratically with prompt length. An 8B model needs about half an hour on one A100 to ingest a 1M-token prompt. MInference is a training-free way to cut this delay. The authors observe that attention… - RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval (2024 · 66 citations)
Serving LLMs with very long contexts is expensive. Attention cost grows with sequence length, and the KV cache for Llama-3-8B reaches roughly 125GB at one million tokens, which no consumer GPU can hold. RetrievalAttention is a training-free method that exploits the fact that each decoding step depends strongly on…
Co-authors here
- Chengruidong Zhang ×2
- Huiqiang Jiang ×2
- Chen Chen
- Chin-Yew Lin
- Di Liu
- Dongsheng Li
- Fan Yang
- Kai Zhang
- Lili Qiu
- Meng Chen
- Qi Chen
- Qianhui Wu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhenhua-han/