🔗 Who cites «The Impact of Positional Encoding on Length Generalization in Transformers»

91 papers of our library cite it (of the 149,439 whose bibliographies we read) · 14 with a page here, the most cited first · ← back to «The Impact of Positional Encoding on Length Generalization in Transformers»

1. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
2. Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,430 citations
3. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
4. LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chi Han, Qifan Wang, Hao Peng, et al.2024 · 95 citations
5. Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionarXiv:2404.07143Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal2024 · 80 citations
6. Mission: Impossible Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Julie Kallini, Isabel Papadimitriou, Richard Futrell, et al.2024 · 70 citations
7. What Algorithms can Transformers Learn? A Study in Length GeneralizationarXiv:2310.16028Hattie Zhou, Arwen Bradley, Etai Littwin, et al.2023 · 67 citations
8. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
9. Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
10. Dataset Decomposition: Faster LLM Training with Variable Sequence Length CurriculumConference on Neural Information Processing Systems (NeurIPS)Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.2024 · 16 citations
11. Base of RoPE Bounds Context LengtharXiv:2405.14591Xin Men, Mingyu Xu, Bingning Wang, et al.2024 · 12 citations
12. Adaptive Zooming via Relevance-Informed Positional Resource Allocation for Training-free LLM Context ExtensionFindings of the Association for Computational LinguisticsHongbo Zhao, Huibin Wang, Bin Tang, et al.2026
13. Position Encoding with Random Float Sampling Enhances Length Generalization of TransformersFindings of the Association for Computational LinguisticsAtsushi Shimizu, Shohei Taniguchi, Yutaka Matsuo2026
14. SCOPE: Boosting LLM Efficiency with Scoped Position EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Qingguo Qi, Hongyang Chen, Zhao Li2026

77 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/kazemnejad-2023-impact-positional-encoding-length-generalization/cited-by/