Songlin Yang
Songlin Yang has 2 papers in our library, in 2023–2025, most of them on Efficient models & compression; often with Enzhe Lu, Fanqing Meng, Jiaxi Hu.
OpenAlex · h-index 1 · 1 works · 35 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 87 times in our library · ⭐ Paper Stars ranking: #7899
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
Works by year
2020s
Papers
- Hierarchically Gated Recurrent Neural Network for Sequence Modeling (2023 · 73 citations)
Transformers scale quadratically with sequence length. RNNs run in linear time but are traditionally slow to train and weak at capturing distant context. The authors propose HGRN (Hierarchically Gated Recurrent Neural Network), a stack of layers that pairs an HGRU token mixer with a GLU channel mixer. HGRU uses… - Kimi Linear: An Expressive, Efficient Attention Architecture (2025 · 51 citations)
Softmax attention becomes a bottleneck for agentic and RL-heavy LLM workloads. Its cost grows quadratically with sequence length, and its KV cache keeps expanding during long decoding. Earlier linear-attention and hybrid designs saved compute but usually lost quality or were only tested at small scale. The Kimi Team…
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/songlin-yang/