Enzhe Lu
Enzhe Lu has 2 papers in our library, in 2025, most of them on Language models & pretraining, Efficient models & compression; often with Jiaxi Hu, Kimi Team, Xin Men.
OpenAlex · h-index 4 · 7 works · 180 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 688 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6428
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workEfficient models & compression · 1 work
Works by year
2020s
Papers
- MoBA: Mixture of Block Attention for Long-Context LLMs (2025 · 80 citations)
Standard softmax attention grows quadratically with sequence length, which makes long-context LLMs expensive to train and run. - Kimi Linear: An Expressive, Efficient Attention Architecture (2025 · 51 citations)
Softmax attention becomes a bottleneck for agentic and RL-heavy LLM workloads. Its cost grows quadratically with sequence length, and its KV cache keeps expanding during long decoding. Earlier linear-attention and hybrid designs saved compute but usually lost quality or were only tested at small scale. The Kimi Team…
All works
- Muon is Scalable for LLM Training ↗arXiv:2502.16982 · no summary yetJingyuan Liu et al.2025 · 83 citations
- MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/enzhe-lu/