Xin Men
Xin Men has 3 papers in our library, in 2024–2025, most of them on Language models & pretraining, Efficient models & compression; often with Bingning Wang, Hongyu Lin, Mingyu Xu.
OpenAlex · h-index 2 · 5 works · 62 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 181 times in our library · ⭐ Paper Stars ranking: #5414
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksComputer Vision and Pattern Recognition · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workEfficient models & compression · 1 work
Works by year
2020s
Papers
- ShortGPT: Layers in Large Language Models are More Redundant Than You Expect (2024 · 170 citations)
Modern LLMs are expensive to deploy, and many existing pruning techniques are complicated, for example those that require gradients. - Kimi Linear: An Expressive, Efficient Attention Architecture (2025 · 51 citations)
Softmax attention becomes a bottleneck for agentic and RL-heavy LLM workloads. Its cost grows quadratically with sequence length, and its KV cache keeps expanding during long decoding. Earlier linear-attention and hybrid designs saved compute but usually lost quality or were only tested at small scale. The Kimi Team… - Base of RoPE Bounds Context Length (2024 · 12 citations)
RoPE is the standard position encoding in many LLMs, and context windows are usually extended by changing its single hyperparameter, the base.
Co-authors here
- Bingning Wang ×2
- Hongyu Lin ×2
- Mingyu Xu ×2
- Qingyu Zhang ×2
- Weipeng Chen ×2
- Xianpei Han ×2
- Enzhe Lu
- Jiaxi Hu
- Kimi Team
- Xingcheng Yao
- Yaojie Lu
- Yu Zhang
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/xin-men/