🔗 Who cites «LongNet: Scaling Transformers to 1,000,000,000 Tokens»

89 papers of our library cite it (of the 149,439 whose bibliographies we read) · 26 with a page here, the most cited first · ← back to «LongNet: Scaling Transformers to 1,000,000,000 Tokens»

1. Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,430 citations
2. A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
3. LongBench: A Bilingual, Multitask Benchmark for Long Context UnderstandingarXiv:2308.14508Yushi Bai, Xin Lv, Jiajie Zhang, et al.2023 · 514 citations
4. Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelarXiv:2401.09417Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.2024 · 500 citations
5. RULER: What's the Real Context Size of Your Long-Context Language Models?arXiv:2404.06654Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 400 citations
6. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
7. LongLoRA: Efficient Fine-tuning of Long-Context Large Language ModelsarXiv:2309.12307Yukang Chen, Shengju Qian, Haotian Tang, et al.2023 · 268 citations
8. MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
9. Effective Long-Context Scaling of Foundation ModelsarXiv:2309.16039Wenhan Xiong, Jingyu Liu, Igor Molybog, et al.2023 · 184 citations
10. LooGLE: Can Long-Context Language Models Understand Long Contexts?Annual Meeting of the Association for Computational Linguistics (ACL)Jiaqi Li, Mengmeng Wang, Zilong Zheng, et al.2023 · 165 citations
11. L-Eval: Instituting Standardized Evaluation for Long Context Language ModelsarXiv:2307.11088Chenxin An, Shansan Gong, Ming Zhong, et al.2023 · 161 citations
12. LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt CompressionarXiv:2310.06839Huiqiang Jiang, Qianhui Wu, Xufang Luo, et al.2023 · 158 citations
13. From Persona to Personalization: A Survey on Role-Playing Language AgentsarXiv:2404.18231Jiangjie Chen, Xintao Wang, Rui Xu, et al.2024 · 115 citations
14. In-context Autoencoder for Context Compression in a Large Language ModelarXiv:2307.06945Tao Ge, Jing Hu, Lei Wang, et al.2023 · 114 citations
15. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
16. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
17. LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chi Han, Qifan Wang, Hao Peng, et al.2024 · 95 citations
18. BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-HaystackConference on Neural Information Processing Systems (NeurIPS)Yuri Kuratov, Aydar Bulatov, Petr Anokhin, et al.2024 · 88 citations
19. MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
20. Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionarXiv:2404.07143Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal2024 · 80 citations
21. Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
22. Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
23. LongReward: Improving Long-context Large Language Models with AI FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL)Jiajie Zhang, Zhongni Hou, Xin Lv, et al.2025 · 21 citations
24. Latent-Condensed Transformer for Efficient Long Context ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Zeng You, Yaofo Chen, Qiuwu Chen, et al.2026
25. MATCH: Modulating Attention via In-Context Retrieval for Long-Context TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Linrui Ma, Chun Hei Lo, Xinyu Wang, et al.2026
26. RepoDistill: Distilling Repository Knowledge through Compression-Aware Budget Allocation and Policy OptimizationFindings of the Association for Computational LinguisticsXin Yin, Zixiang Ding, Yiang Zhang, et al.2026

63 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/ding-2023-longnet-scaling-transformers-1-000/cited-by/