Who cites «A Length-Extrapolatable Transformer»
- Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
- LongBench: A Bilingual, Multitask Benchmark for Long Context UnderstandingarXiv:2308.14508Yushi Bai, Xin Lv, Jiajie Zhang, et al.2023 · 506 citations
- RULER: What's the Real Context Size of Your Long-Context Language Models?arXiv:2404.06654Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 386 citationsLanguage Is Not All You Need: Aligning Perception with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shaohan Huang, Li Dong, Wenhui Wang, et al.2023 · 322 citations
- Effective Long-Context Scaling of Foundation ModelsarXiv:2309.16039Wenhan Xiong, Jingyu Liu, Igor Molybog, et al.2023 · 177 citations
- L-Eval: Instituting Standardized Evaluation for Long Context Language ModelsarXiv:2307.11088Chenxin An, Shansan Gong, Ming Zhong, et al.2023 · 160 citationsInfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context MemoryConference on Neural Information Processing Systems (NeurIPS)Chaojun Xiao, Pengle Zhang, Xu Han, et al.2024 · 125 citationsLM-Infinite: Zero-Shot Extreme Length Generalization for Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chi Han, Qifan Wang, Hao Peng, et al.2024 · 95 citations
- LLM Maybe LongLM: Self-Extend LLM Context Window Without TuningarXiv:2401.01325Hongye Jin, Xiaotian Han, Jingfeng Yang, et al.2024 · 78 citationsLeave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAConference on Empirical Methods in Natural Language Processing (EMNLP)Minzheng Wang, Longze Chen, Fu Cheng, et al.2024 · 71 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citationsBAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsLanguage Resources and Evaluation Conference (LREC)Zican Dong, Tianyi Tang, Junyi Li, et al.2024 · 59 citations
- Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 53 citations
A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,863 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/sun-2023-length-extrapolatable-transformer/cited-by/