🔗 Who cites «Retentive Network: A Successor to Transformer for Large Language Models»

161 papers of our library cite it (of the 149,439 whose bibliographies we read) · 40 with a page here, the most cited first · ← back to «Retentive Network: A Successor to Transformer for Large Language Models»

1. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
2. Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelarXiv:2401.09417Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.2024 · 500 citations
3. FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
4. RULER: What's the Real Context Size of Your Long-Context Language Models?arXiv:2404.06654Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 400 citations
5. Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
6. xLSTM: Extended Long Short-Term MemoryConference on Neural Information Processing Systems (NeurIPS)Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.2024 · 296 citations
7. MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
8. L-Eval: Instituting Standardized Evaluation for Long Context Language ModelsarXiv:2307.11088Chenxin An, Shansan Gong, Ming Zhong, et al.2023 · 161 citations
9. LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt CompressionarXiv:2310.06839Huiqiang Jiang, Qianhui Wu, Xufang Luo, et al.2023 · 158 citations
10. MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUsarXiv:2402.15627Ziheng Jiang, Haibin Lin, Yinmin Zhong, et al.2024 · 157 citations
11. SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked PrefillsarXiv 2023Amey Agrawal, Ashish Panwar, Jayashree Mohan, et al.2023 · 144 citations
12. A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
13. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
14. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
15. Data Engineering for Scaling Language Models to 128K ContextarXiv:2402.10171Yao Fu, Rameswar Panda, Xinyao Niu, et al.2024 · 109 citations
16. How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
17. MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
18. MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
19. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
20. Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
21. BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsLanguage Resources and Evaluation Conference (LREC)Zican Dong, Tianyi Tang, Junyi Li, et al.2024 · 59 citations
22. Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
23. Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
24. A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
25. Zoology: Measuring and Improving Recall in Efficient Language ModelsarXiv:2312.04927Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou; Atri Rudra;, Christopher Re2023 · 55 citations
26. Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
27. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
28. Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language ModelsarXiv:2401.04658Zhen Qin, Weigao Sun, Dong Li, et al.2024 · 31 citations
29. RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
30. Linearizing Large Language ModelsarXiv:2405.06640Jean Mercat, Igor Vasiljevic, Sedrick Keh, et al.2024 · 16 citations
31. A Survey on Latent ReasoningarXiv:2507.06203Rui-Jie Zhu, Tianhao Peng, Tianhao Cheng, et al.2025 · 15 citations
32. MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
33. PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
34. Associative Recurrent Memory TransformerarXiv:2407.04841Ivan Rodkin, Yuri Kuratov, Aydar Bulatov, et al.2024 · 8 citations
35. MoM: Linear Sequence Modeling with Mixture-of-MemoriesarXiv:2502.13685Jusen Du, Weigao Sun, Disen Lan, et al.2025 · 7 citations
36. DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context ReasoningFindings of the Association for Computational LinguisticsHossein Entezari Zarch, Lei Gao, Chaoyi Jiang, et al.2026 · 1 citation
37. StateX: Enhancing RNN Recall via Post-training State ExpansionFindings of the Association for Computational LinguisticsXingyu Shen, Yingfa Chen, Zhen Leng Thai, et al.2026 · 1 citation
38. A Survey of Retentive NetworkFindings of the Association for Computational LinguisticsHaiqi Yang, Zhiyuan Li, Yi Chang, et al.2026
39. CoMeT: Collaborative Memory Transformer for Efficient Long Context ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Runsong Zhao, Shilei Liu, Jiwei Tang, et al.2026
40. RetentiveKV: State-Space Memory for Uncertainty-Aware Multimodal KV Cache EvictionFindings of the Association for Computational LinguisticsSihao Liu, YuFan Xiong, Zhonghua Jiang, et al.2026

121 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/sun-2023-retentive-network-successor-transformer-large/cited-by/