Jiaxi Hu
Jiaxi Hu has 3 papers in our library, in 2025, most of them on Language models & pretraining, Efficient models & compression; often with Disen Lan, Jusen Du, Weigao Sun.
OpenAlex · ORCID · Wikidata · h-index 13 · 41 works · 2,128 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 66 times in our library · ⭐ Paper Stars ranking: #7389
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksComputer Vision and Pattern Recognition · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Kimi Linear: An Expressive, Efficient Attention Architecture (2025 · 51 citations)
Softmax attention becomes a bottleneck for agentic and RL-heavy LLM workloads. Its cost grows quadratically with sequence length, and its KV cache keeps expanding during long decoding. Earlier linear-attention and hybrid designs saved compute but usually lost quality or were only tested at small scale. The Kimi Team… - Liger: Linearizing Large Language Models to Gated Recurrent Structures (2025 · 9 citations)
Transformer LLMs have attention cost that grows quadratically with sequence length, and their KV cache keeps growing during generation. - MoM: Linear Sequence Modeling with Mixture-of-Memories (2025 · 7 citations)
Linear sequence models such as linear attention, state space models and linear RNNs train in linear time and run inference with constant cost.
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jiaxi-hu/