Who cites «Hymba: A Hybrid-head Architecture for Small Language Models»
- DeepSeek-V4: Towards Highly Efficient Million-Token Context IntelligencearXiv:2606.19348DeepSeek-AI, Anyi Xu, Bangcai Lin, et al.2026 · 122 citations
- Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- Towards Reasoning Ability of Small Language ModelsarXiv:2502.11569Gaurav Srivastava, Shuxiang Cao, Xuan Wang2025 · 16 citations
- Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and PerformancearXiv:2507.22448Jingwei Zuo, Maksim Velikanov, Ilyas Chahed, et al.2025 · 15 citations
- FlowHN: Adaptive Token Routing for Efficient Parallel Hybrid NetworksAnnual Meeting of the Association for Computational Linguistics (ACL)Mohammad Mahdi Moradi, Walid Ahmed, Shuangyue Wen, et al.2026
- MATCH: Modulating Attention via In-Context Retrieval for Long-Context TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Linrui Ma, Chun Hei Lo, Xinyu Wang, et al.2026
- Understanding In-Context Learning Beyond Transformers: An Investigation of State Space and Hybrid ArchitecturesFindings of the Association for Computational LinguisticsShenran Wang, Timothy Tin-Long Tse, Jian Zhu2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/dong-2024-hymba-hybrid-head-architecture-small/cited-by/