Elamur Research⌕
☰
home / papers / Scaling Laws for Neural Language Models / cited by

Who cites «Scaling Laws for Neural Language Models»

1,823 papers of our library cite it (of the 141,840 whose bibliographies we read) · 203 with a page here, the most cited first · page 1 of 3 · 1–100 · ← back to «Scaling Laws for Neural Language Models»

1 2 3

  1. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 13,703 citations
  2. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsarXiv:2201.11903Jason Wei, Xuezhi Wang, Dale Schuurmans, et al.2022 · 11,308 citations
  3. LLaMA: Open and Efficient Foundation Language ModelsarXiv:2302.13971Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 9,472 citations
  4. Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,328 citations
  5. PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,680 citations
  6. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningNatureDeepSeek-AI, Daya Guo, Dejian Yang, et al.2025 · 4,593 citations
  7. Training Verifiers to Solve Math Word ProblemsarXiv:2110.14168Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.2021 · 3,680 citations
  8. Measuring Massive Multitask Language UnderstandingarXiv:2009.03300Dan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 3,495 citations
  9. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,056 citations
  10. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,863 citations
  11. Evaluating Large Language Models Trained on CodearXiv:2107.03374Mark Chen, Jerry Tworek, Heewoo Jun, et al.2021 · 2,548 citations
  12. Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingarXiv:2205.11487Chitwan Saharia, William Chan, Saurabh Saxena, et al.2022 · 2,423 citations
  13. Measuring Mathematical Problem Solving With the MATH DatasetarXiv:2103.03874Dan Hendrycks, Collin Burns, Saurav Kadavath, et al.2021 · 2,320 citations
  14. Emergent Abilities of Large Language ModelsarXiv:2206.07682Jason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,229 citations
  15. Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,118 citations
  16. TruthfulQA: Measuring How Models Mimic Human FalsehoodsAnnual Meeting of the Association for Computational Linguistics (ACL)Stephanie Lin, Jacob Hilton, Owain Evans2022 · 2,052 citations
  17. Training Compute-Optimal Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.2022 · 1,950 citations
  18. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,703 citations
  19. Retrieval-Augmented Generation for Large Language Models: A SurveyarXiv:2312.10997Yunfan Gao, Yun Xiong, Xinyu Gao, et al.2023 · 1,648 citations
  20. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,552 citations
  21. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,522 citations
  22. LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,403 citations
  23. LaMDA: Language Models for Dialog ApplicationsarXiv:2201.08239Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,326 citations
  24. A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
  25. The Rise and Potential of Large Language Model Based Agents: A SurveyScience China Information SciencesZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,264 citations
  26. Recipes for Building an Open-Domain ChatbotConference of the European Chapter of the Association for Computational Linguistics (EACL)Stephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,208 citations
  27. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhonearXiv:2404.14219Marah Abdin, Jyoti Aneja, Hany Awadalla, et al.2024 · 1,113 citations
  28. Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemFindings of the Association for Computational LinguisticsMirac Suzgun, Nathan Scales, Nathanael Schärli, et al.2023 · 1,096 citations
  29. PaLM 2 Technical ReportarXiv:2305.10403Rohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 977 citations
  30. Extracting Training Data from Large Language ModelsarXiv:2012.07805Nicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 911 citations
  31. Segment AnythingarXiv:2304.02643Alexander Kirillov, Eric Mintun, Nikhila Ravi, et al.2023 · 868 citations
  32. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelBigScience Episode – Workshop on Challenges & Perspectives in Creating Large Language ModelsSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 821 citations
  33. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondarXiv:2304.13712Jingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 811 citations
  34. Can Large Language Models Transform Computational Social Science?Computational LinguisticsCaleb Ziems, William Held, Omar Shaikh, et al.2023 · 777 citations
  35. Reproducible scaling laws for contrastive language-image learningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 751 citations
  36. AdapterHub: A Framework for Adapting TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.2020 · 748 citations
  37. Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningConference on Neural Information Processing Systems (NeurIPS)Haokun Liu, Derek Tam, Mohammed Muqeeth, et al.2022 · 736 citations
  38. Capabilities of GPT-4 on Medical Challenge ProblemsarXiv:2303.13375Harsha Nori, Nicholas King, Scott Mayer McKinney, et al.2023 · 711 citations
  39. Large Language Models Are Human-Level Prompt EngineersarXiv:2211.01910Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.2022 · 678 citations
  40. BloombergGPT: A Large Language Model for FinancearXiv:2303.17564Shijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 612 citations
  41. s1: Simple test-time scalingConference on Empirical Methods in Natural Language Processing (EMNLP)Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 584 citations
  42. Document Ranking with a Pretrained Sequence-to-Sequence ModelFindings of the Association for Computational LinguisticsRodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, et al.2020 · 540 citations
  43. LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text PairsarXiv:2111.02114Christoph Schuhmann, Richard Vencu, Romain Beaumont, et al.2021 · 530 citations
  44. Baichuan 2: Open Large-scale Language ModelsarXiv:2309.10305Aiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 513 citations
  45. Multilingual Machine Translation with Large Language Models: Empirical Results and AnalysisFindings of the Association for Computational LinguisticsWenhao Zhu, Hongyi Liu, Qingxiu Dong, et al.2024 · 503 citations
  46. GLaM: Efficient Scaling of Language Models with Mixture-of-ExpertsarXiv:2112.06905Nan Du, Yanping Huang, Andrew M. Dai, et al.2021 · 479 citations
  47. Large Language Models: A SurveyarXiv:2402.06196Shervin Minaee, Tomas Mikolov, Narjes Nikzad, et al.2024 · 468 citations
  48. XCOPA: A Multilingual Dataset for Causal Commonsense ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Edoardo Maria Ponti, Goran Glavaš, Olga Majewska, et al.2020 · 465 citations
  49. OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific ProblemsAnnual Meeting of the Association for Computational Linguistics (ACL)Chaoqun He, Renjie Luo, Yuzhuo Bai, et al.2024 · 448 citations
  50. The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  51. Kimi k1.5: Scaling Reinforcement Learning with LLMsarXiv:2501.12599Kimi Team, Angang Du, Bofei Gao, et al.2025 · 413 citations
  52. Yi: Open Foundation Models by 01.AIarXiv:2403.04652Alex Young, Bei Chen, Chao Li, et al.2024 · 402 citations
  53. LongT5: Efficient Text-To-Text Transformer for Long SequencesFindings of the Association for Computational LinguisticsMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 398 citations
  54. A Survey on Model Compression for Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Xunyu Zhu, Jian Li, Yong Liu, et al.2024 · 381 citations
  55. ChatDev: Communicative Agents for Software DevelopmentarXiv:2307.07924Chen Qian, Wei Liu, Hongzhang Liu, et al.2023 · 373 citations
  56. A Survey on Large Language Models for Code GenerationarXiv:2406.00515Juyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 366 citations
  57. TinyLlama: An Open-Source Small Language ModelarXiv:2401.02385Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 351 citations
  58. Reformulating Unsupervised Style Transfer as Paraphrase GenerationKalpesh Krishna, John Wieting, Mohit Iyyer2020 · 348 citations
  59. Toxicity in chatgpt: Analyzing persona-assigned language modelsFindings of the Association for Computational LinguisticsAmeet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, et al.2023 · 346 citations
  60. Complexity-Based Prompting for Multi-Step ReasoningarXiv:2210.00720Yao Fu, Hao Peng, Ashish Sabharwal, et al.2022 · 343 citations
  61. PaLI: A Jointly-Scaled Multilingual Language-Image ModelarXiv:2209.06794Xi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 341 citations
  62. Large Language Models for Information Retrieval: A SurveyACM Transactions on Information SystemsYutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen2023 · 335 citations
  63. UL2: Unifying Language Learning ParadigmsarXiv:2205.05131Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 335 citations
  64. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2107.02137Yu Sun, Shuohuan Wang, Shikun Feng, et al.2021 · 328 citations
  65. Are Emergent Abilities of Large Language Models a Mirage?Conference on Neural Information Processing Systems (NeurIPS)Rylan Schaeffer, Brando Miranda, Sanmi Koyejo2023 · 323 citations
  66. Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive DecodingIEEE Computer Society Conference on Computer Vision and Pattern RecognitionSicong Leng, Hang Zhang, Guanzheng Chen, et al.2023 · 317 citations
  67. Faith and Fate: Limits of Transformers on CompositionalityConference on Neural Information Processing Systems (NeurIPS)Nouha Dziri, Ximing Lu, Melanie Sclar, et al.2023 · 313 citations
  68. MEDITRON-70B: Scaling Medical Pretraining for Large Language ModelsarXiv:2311.16079Zeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.2023 · 311 citations
  69. Discovering Language Model Behaviors with Model-Written EvaluationsarXiv:2212.09251Ethan Perez, Sam Ringer, Kamilė Lukošiūtė, et al.2022 · 307 citations
  70. Carbon Emissions and Large Neural Network TrainingarXiv:2104.10350David Patterson, Joseph Gonzalez, Quoc Le, et al.2021 · 305 citations
  71. ZeRO-Offload: Democratizing Billion-Scale Model TrainingarXiv:2101.06840Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.2021 · 303 citations
  72. Scaling Laws for Reward Model OveroptimizationarXiv:2210.10760Leo Gao, John Schulman, Jacob Hilton2022 · 302 citations
  73. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
  74. Prompting Large Language Model for Machine Translation: A Case StudyarXiv:2301.07069Biao Zhang, Barry Haddow, Alexandra Birch2023 · 293 citations
  75. Can language models learn from explanations in context?Findings of the Association for Computational LinguisticsAndrew Lampinen, Ishita Dasgupta, Stephanie Chan, et al.2022 · 290 citations
  76. On-Policy Distillation of Language Models: Learning from Self-Generated MistakesarXiv:2306.13649Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, et al.2023 · 288 citations
  77. Generate rather than Retrieve: Large Language Models are Strong Context GeneratorsarXiv:2209.10063Wenhao Yu, Dan Iter, Shuohang Wang, et al.2022 · 280 citations
  78. Llemma: An Open Language Model For MathematicsarXiv:2310.10631Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 276 citations
  79. The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsAnnual Meeting of the Association for Computational Linguistics (ACL)Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.2023 · 259 citations
  80. MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training StrategiesarXiv:2404.06395Shengding Hu, Yuge Tu, Xu Han, et al.2024 · 258 citations
  81. Scaling Laws for Autoregressive Generative ModelingarXiv:2010.14701Tom Henighan, Jared Kaplan, Mor Katz, et al.2020 · 257 citations
  82. DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI ScalearXiv:2201.05596Samyam Rajbhandari, Conglong Li, Zhewei Yao, et al.2022 · 255 citations
  83. LexGLUE: A Benchmark Dataset for Legal Language Understanding in EnglisharXiv:2110.00976Ilias Chalkidis; Abhik Jana; Dirk Hartung; Michael Bommarito; Ion Androutsopoulos; Daniel Martin Katz;, Nikolaos Aletras2021 · 254 citations
  84. Scaling Relationship on Learning Mathematical Reasoning with Large Language ModelsarXiv:2308.01825Zheng Yuan, Hongyi Yuan, Chengpeng Li, et al.2023 · 252 citations
  85. Personality Traits in Large Language ModelsarXiv:2307.00184Greg Serapio-Garcia, Mustafa Safdari, Clement Crepy, et al.2023 · 251 citations
  86. Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and ToxicityarXiv:2301.12867Terry Yue Zhuo, Yujin Huang, Chunyang Chen, et al.2023 · 246 citations
  87. NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each BenchmarkFindings of the Association for Computational LinguisticsOscar Sainz, Jon Campos, Iker García-Ferrero, et al.2023 · 245 citations
  88. Perceiver: General Perception with Iterative AttentionarXiv:2103.03206Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 242 citations
  89. Large Language Monkeys: Scaling Inference Compute with Repeated SamplingarXiv:2407.21787Bradley Brown, Jordan Juravsky, Ryan Ehrlich, et al.2024 · 241 citations
  90. Translation between Molecules and Natural LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Carl Edwards, Tuan Lai, Kevin Ros, et al.2022 · 236 citations
  91. TrustLLM: Trustworthiness in Large Language ModelsarXiv:2401.05561Yue Huang, Lichao Sun, Haoran Wang, et al.2024 · 226 citations
  92. Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingarXiv:2305.07004Haoyang Huang, Tianyi Tang, Dongdong Zhang, et al.2023 · 224 citations
  93. GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical InformationBioinformaticsQiao Jin, Yifan Yang, Qingyu Chen, et al.2023 · 222 citations
  94. Specializing Smaller Language Models towards Multi-Step ReasoningarXiv:2301.12726Yao Fu, Hao Peng, Litu Ou, et al.2023 · 222 citations
  95. Beyond neural scaling laws: beating power law scaling via data pruningConference on Neural Information Processing Systems (NeurIPS)Ben Sorscher, Robert Geirhos, Shashank Shekhar, et al.2022 · 220 citations
  96. Transformer Memory as a Differentiable Search IndexConference on Neural Information Processing Systems (NeurIPS)Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.2022 · 220 citations
  97. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsarXiv:2308.16149Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 217 citations
  98. Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LuncharXiv:2311.03099Le Yu, Bowen Yu, Haiyang Yu, et al.2023 · 210 citations
  99. Prompting GPT-3 To Be ReliablearXiv:2210.09150Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.2022 · 207 citations
  100. LIMO: Less is More for ReasoningarXiv:2502.03387Yixin Ye, Zhen Huang, Yang Xiao, et al.2025 · 204 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/