Zhiyuan Li
Zhiyuan Li has 2 papers in our library, in 2025–2026, most of them on Efficient models & compression; often with Enzhe Lu, Jiaxi Hu, Kimi Team.
OpenAlex · ORCID · h-index 17 · 68 works · 818 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 92 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #9010
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
Works by year
2020s
Papers
- Kimi Linear: An Expressive, Efficient Attention Architecture (2025 · 51 citations)
Softmax attention becomes a bottleneck for agentic and RL-heavy LLM workloads. Its cost grows quadratically with sequence length, and its KV cache keeps expanding during long decoding. Earlier linear-attention and hybrid designs saved compute but usually lost quality or were only tested at small scale. The Kimi Team… - A Survey of Retentive Network (2026)
Transformers scale poorly on long inputs: self-attention costs grow quadratically with sequence length during training, and the per-token KV cache inflates memory use at inference.
All works
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- Reasoning with Latent Thoughts: On the Power of Looped Transformers ↗arXiv:2502.17416 · no summary yetNikunj Saunshi et al.2025 · 44 citations
- A Survey of Retentive NetworkFindings of the Association for Computational LinguisticsHaiqi Yang, Zhiyuan Li, Yi Chang, et al.2026
Co-authors here
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhiyuan-li/