Who cites «Jamba: A Hybrid Transformer-Mamba Language Model»
- MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
- Mooncake: A KVCache-centric Disaggregated Architecture for LLM ServingFAST 2025Ruoyu Qin, Zheming Li, Weiran He, et al.2024 · 161 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-HaystackConference on Neural Information Processing Systems (NeurIPS)Yuri Kuratov, Aydar Bulatov, Petr Anokhin, et al.2024 · 88 citations
- An Empirical Study of Mamba-based Language ModelsarXiv:2406.07887Roger Waleffe, Wonmin Byeon, Duncan Riach, et al.2024 · 67 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
- Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
- Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Sander Land, Max Bartolo2024 · 42 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning ModelarXiv:2508.14444NVIDIA: Aarti Basant, Abhijit Khairnar, Abhijit Paithankar, et al.2025 · 39 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- The Hidden Attention of Mamba ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Ameen Ali Ali, Itamar Zimerman, Lior Wolf2025 · 32 citations
- Jamba-1.5: Hybrid Transformer-Mamba Models at ScalearXiv:2408.12570Jamba Team: Barak Lenz, Alan Arazi, Amir Bergman, et al.2024 · 30 citations
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic ReasoningarXiv:2512.20848NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, et al.2025 · 27 citations
- Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and PerformancearXiv:2507.22448Jingwei Zuo, Maksim Velikanov, Ilyas Chahed, et al.2025 · 15 citations
- Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
- MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
- GitChameleon 2.0: Evaluating AI Code Generation Against Python Library Version IncompatibilitiesAnnual Meeting of the Association for Computational Linguistics (ACL)Diganta Misra, Nizar Islah, Victor May, et al.2026 · 2 citations
- Can Models Help Us Create Better Models? Evaluating LLMs as Data ScientistsFindings of the Association for Computational LinguisticsMichał Pietruszka, Łukasz Borchmann, Aleksander Jędrosz, et al.2026 · 1 citation
- FlowHN: Adaptive Token Routing for Efficient Parallel Hybrid NetworksAnnual Meeting of the Association for Computational Linguistics (ACL)Mohammad Mahdi Moradi, Walid Ahmed, Shuangyue Wen, et al.2026
- XLSR-MamBo: Scaling the Hybrid Mamba-Attention Backbone for Audio Deepfake DetectionFindings of the Association for Computational LinguisticsKwok-Ho Ng, Tingting Song, Yongdong WU, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/lieber-2024-jamba-hybrid-transformer-mamba-language/cited-by/