🔗 Who cites «RoFormer: Enhanced Transformer with Rotary Position Embedding»

1,072 papers of our library cite it (of the 140,884 whose bibliographies we read) · 85 with a page here, the most cited first · ← the paper

1. LLaMA: Open and Efficient Foundation Language ModelsHugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 5,609 citations
2. Qwen3 Technical ReportAn Yang, Anfeng Li, Baosong Yang, et al.2025 · 3,276 citations
3. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,221 citations
4. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
5. PaLM: Scaling Language Modeling with PathwaysAakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 2,603 citations
6. Qwen Technical ReportJinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,643 citations
7. Code Llama: Open Foundation Models for CodeBaptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
8. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
9. Qwen2.5-VL Technical ReportShuai Bai, Keqin Chen, Xuejing Liu, et al.2025 · 948 citations
10. Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any ResolutionPeng Wang, Shuai Bai, Sinan Tan, et al.2024 · 819 citations
11. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 818 citations
12. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
13. ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All ToolsTeam GLM, Aohan Zeng, Bin Xu, et al.2024 · 687 citations
14. BloombergGPT: A Large Language Model for FinanceShijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 608 citations
15. gpt-oss-120b & gpt-oss-20b Model CardOpenAI: Sandhini Agarwal, Lama Ahmad, Jason Ai, et al.2025 · 555 citations
16. Baichuan 2: Open Large-scale Language ModelsAiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 512 citations
17. Large Language Models: A SurveyShervin Minaee, Tomas Mikolov, Narjes Nikzad, et al.2024 · 467 citations
18. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
19. Improving Text Embeddings with Large Language ModelsLiang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 433 citations
20. Kimi k1.5: Scaling Reinforcement Learning with LLMsKimi Team, Angang Du, Bofei Gao, et al.2025 · 413 citations
21. Yi: Open Foundation Models by 01.AIAlex Young, Bei Chen, Chao Li, et al.2024 · 402 citations
22. RULER: What's the Real Context Size of Your Long-Context Language Models?Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 386 citations
23. A Survey on Large Language Models for Code GenerationJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 366 citations
24. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 355 citations
25. TinyLlama: An Open-Source Small Language ModelPeiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 350 citations
26. Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
27. KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache QuantizationColeman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.2024 · 293 citations
28. Efficient and Effective Text Encoding for Chinese LLaMA and AlpacaYiming Cui, Ziqing Yang, Xin Yao2023 · 285 citations
29. Llemma: An Open Language Model For MathematicsZhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 275 citations
30. LongLoRA: Efficient Fine-tuning of Long-Context Large Language ModelsYukang Chen, Shengju Qian, Haotian Tang, et al.2023 · 265 citations
31. QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMsSaleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, et al.2024 · 252 citations
32. mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalXin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 236 citations
33. Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyZeyu Han, Chao Gao, Jinyang Liu, et al.2024 · 236 citations
34. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsNeha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 217 citations
35. DeepSeek-VL: Towards Real-World Vision-Language UnderstandingHaoyu Lu, Wen Liu, Bo Zhang, et al.2024 · 201 citations
36. Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferenceJiaming Tang, Yilong Zhao, Kan Zhu, et al.2024 · 197 citations
37. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 184 citations
38. Aya Expanse: Combining Research Breakthroughs for a New Multilingual FrontierJohn Dang, Shivalika Singh, Daniel D'souza, et al.2024 · 180 citations
39. Adapting Language Models to Compress ContextsAlexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 179 citations
40. Effective Long-Context Scaling of Foundation ModelsWenhan Xiong, Jingyu Liu, Igor Molybog, et al.2023 · 177 citations
41. Aya 23: Open Weight Releases to Further Multilingual ProgressViraat Aryabumi, John Dang, Dwarak Talupuru, et al.2024 · 171 citations
42. ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectXin Men, Mingyu Xu, Qingyu Zhang, et al.2024 · 167 citations
43. Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, et al.2025 · 164 citations
44. CogVideoX: Text-to-Video Diffusion Models with An Expert TransformerZhuoyi Yang, Jiayan Teng, Wendi Zheng, et al.2024 · 163 citations
45. L-Eval: Instituting Standardized Evaluation for Long Context Language ModelsChenxin An, Shansan Gong, Ming Zhong, et al.2023 · 159 citations
46. DataComp-LM: In search of the next generation of training sets for language modelsJeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 156 citations
47. HunyuanVideo: A Systematic Framework For Large Video Generative ModelsWeijie Kong, Qi Tian, Zijian Zhang, et al.2024 · 155 citations
48. Moshi: a speech-text foundation model for real-time dialogueAlexandre Defossez, Laurent Mazare, Manu Orsini, et al.2024 · 154 citations
49. Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAsMicrosoft, Abdelrahman Abouelenin, Atabak Ashfaq, et al.2025 · 145 citations
50. The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context LearningBill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, et al.2023 · 139 citations
51. LongRoPE: Extending LLM Context Window Beyond 2 Million TokensYiran Ding, Li Lyna Zhang, Chengruidong Zhang, et al.2024 · 138 citations
52. Simple and Effective Masked Diffusion Language ModelsSubham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.2024 · 134 citations
53. Long-context LLMs Struggle with Long In-context LearningTianle Li, Ge Zhang, Quy Duc Do, et al.2024 · 132 citations
54. EuroLLM: Multilingual Language Models for EuropePedro Henrique Martins, Patrick Fernandes, Joao Alves, et al.2024 · 131 citations
55. Retrieval meets Long Context Large Language ModelsPeng Xu, Wei Ping, Xianchao Wu, et al.2023 · 129 citations
56. InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context MemoryChaojun Xiao, Pengle Zhang, Xu Han, et al.2024 · 125 citations
57. Nomic Embed: Training a Reproducible Long Context Text EmbedderZach Nussbaum, John X. Morris, Brandon Duderstadt, et al.2024 · 123 citations
58. DeepSeek-V4: Towards Highly Efficient Million-Token Context IntelligenceDeepSeek-AI, Anyi Xu, Bangcai Lin, et al.2026 · 117 citations
59. Chameleon: Mixed-Modal Early-Fusion Foundation ModelsChameleon Team2024 · 117 citations
60. Qwen3-Omni Technical ReportJin Xu, Zhifang Guo, Hangrui Hu, et al.2025 · 114 citations
61. From Persona to Personalization: A Survey on Role-Playing Language AgentsJiangjie Chen, Xintao Wang, Rui Xu, et al.2024 · 114 citations
62. Demystifying Long Chain-of-Thought Reasoning in LLMsEdward Yeo, Yuxuan Tong, Morry Niu, et al.2025 · 113 citations
63. Olmo 3Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 109 citations
64. DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsGuangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 109 citations
65. Physics of Language Models: Part 3.1, Knowledge Storage and ExtractionZeyuan Allen-Zhu, Yuanzhi Li2023 · 107 citations
66. Nemotron-4 340B Technical ReportNvidia: Bo Adler, Niket Agarwal, Ashwath Aithal, et al.2024 · 102 citations
67. Qwen2.5-1M Technical ReportAn Yang, Bowen Yu, Chengyuan Li, et al.2025 · 100 citations
68. LongAlign: A Recipe for Long Context Alignment of Large Language ModelsYushi Bai, Xin Lv, Jiajie Zhang, et al.2024 · 97 citations
69. Skywork: A More Open Bilingual Foundation ModelTianwen Wei, Liang Zhao, Lichang Zhang, et al.2023 · 91 citations
70. Neural Networks and the Chomsky HierarchyGrégoire Delétang, Anian Ruoss, Jordi Grau-Moya, et al.2022 · 66 citations
71. Scaling Laws of RoPE-based ExtrapolationXiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 53 citations
72. Scaling Laws and Compute-Optimal Training Beyond Fixed Training DurationsAlexander Hägele, Elie Bakouch, Atli Kosson, et al.2024 · 24 citations
73. Distillation Scaling LawsDan Busbridge, Amitis Shidani, Floris Weers, et al.2025 · 23 citations
74. Jais 2: A Family of Arabic-Centric Open Large Language ModelsMohamed Anwar, Abed Alhakim Freihat, George Ibrahim, et al.2026 · 14 citations
75. Resolving Discrepancies in Compute-Optimal Scaling of Language ModelsTomer Porian, Mitchell Wortsman, Jenia Jitsev, et al.2024 · 14 citations
76. DiBiMT: A Gold Evaluation Benchmark for Studying Lexical Ambiguity in Machine TranslationFederico Martelli, Stefano Perrella, Niccolò Campolungo, et al.2025 · 11 citations
77. GemmAr: Enhancing LLMs Through Arabic Instruction-TuningHasna Chouikhi, Manel Aloui, Cyrine Ben Hammou, et al.2024 · 4 citations
78. Scaling Laws for Code: A More Data-Hungry RegimeXianzhen Luo, Wenzhen Zheng, Qingfu Zhu, et al.2026 · 3 citations
79. FalAR: A Large-scale Speaker-Annotated European Portuguese Speech Corpus of Parliamentary SessionsFrancisco Teixeira, Carlos Carvalho, Mariana Julião, et al.2026 · 1 citation
80. LCHAIM - Investigating Long Context Reasoning in HebrewEhud Malul, Oriel Perets, Ziv Mor, et al.2025 · 1 citation
81. AlcLaM: Arabic Dialectal Language ModelMurtadha Ahmed, Saghir Alfasly, Bo Wen, et al.2024 · 1 citation
82. Introducing DictaLM — A Large Generative Language Model for Modern HebrewShaltiel Shmidman, Avi Shmidman, Amir David Nissan Cohen, et al.2023 · 1 citation
83. AYN: A Tiny Yet Competitive Indian Legal Language Model Pretrained from ScratchMitodru Niyogi, Eric Gaussier, Arnab Bhattacharya2026
84. Character-aware Transformers Learn an Irregular Morphological Pattern Yet None Generalize Like HumansAkhilesh Kakolu Ramarao, Kevin Tang, Dinah Baer-Henney2026
85. NeoDictaBERT: Pushing the Frontier of BERT models for HebrewShaltiel Shmidman, Avi Shmidman, Moshe Koppel2025

987 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/su-2021-roformer-enhanced-transformer-rotary-position/cited-by/