Elamur Research⌕
☰
home / papers / Training Compute-Optimal Large Language Models / cited by

Who cites «Training Compute-Optimal Large Language Models»

1,110 papers of our library cite it (of the 140,884 whose bibliographies we read) · 150 with a page here, the most cited first · page 1 of 2 · 1–100 · ← the paper

1 2

  1. LLaMA: Open and Efficient Foundation Language ModelsHugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 5,609 citations
  2. Gemini: A Family of Highly Capable Multimodal ModelsGemini Team, Rohan Anil, Sebastian Borgeaud, et al.2023 · 2,951 citations
  3. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
  4. PaLM: Scaling Language Modeling with PathwaysAakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 2,603 citations
  5. Emergent Abilities of Large Language ModelsJason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,215 citations
  6. Scaling Instruction-Finetuned Language ModelsHyung Won Chung, Le Hou, Shayne Longpre, et al.2022 · 2,176 citations
  7. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, et al.2023 · 2,114 citations
  8. Flamingo: a Visual Language Model for Few-Shot LearningJean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,108 citations
  9. OPT: Open Pre-trained Transformer Language ModelsSusan Zhang, Stephen Roller, Naman Goyal, et al.2022 · 1,709 citations
  10. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,695 citations
  11. Qwen Technical ReportJinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,643 citations
  12. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextGemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,522 citations
  13. DINOv2: Learning Robust Visual Features without SupervisionMaxime Oquab, Timothee Darcet, Theo Moutakanni, et al.2023 · 1,425 citations
  14. Code Llama: Open Foundation Models for CodeBaptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
  15. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
  16. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhoneMarah Abdin, Jyoti Aneja, Hany Awadalla, et al.2024 · 1,113 citations
  17. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,105 citations
  18. Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemMirac Suzgun, Nathan Scales, Nathanael Schärli, et al.2023 · 1,094 citations
  19. Solving Quantitative Reasoning Problems with Language ModelsAitor Lewkowycz, Anders Andreassen, David Dohan, et al.2022 · 973 citations
  20. PaLM 2 Technical ReportRohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 971 citations
  21. C-Pack: Packed Resources For General Chinese EmbeddingsShitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 920 citations
  22. A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and InteractivityYejin Bang, Samuel Cahyawijaya, Nayeon Lee, et al.2023 · 866 citations
  23. Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, et al.2023 · 865 citations
  24. Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Chengwei Qin, Aston Zhang, Zhuosheng Zhang, et al.2023 · 818 citations
  25. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 818 citations
  26. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 806 citations
  27. Can Large Language Models Transform Computational Social Science?Caleb Ziems, William Held, Omar Shaikh, et al.2023 · 776 citations
  28. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
  29. Reproducible scaling laws for contrastive language-image learningMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 750 citations
  30. Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 692 citations
  31. CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model SocietyGuohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, et al.2023 · 689 citations
  32. Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model SizesCheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, et al.2023 · 684 citations
  33. The Flan Collection: Designing Data and Methods for Effective Instruction TuningShayne Longpre, Le Hou, Tu Vu, et al.2023 · 590 citations
  34. s1: Simple test-time scalingNiklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 584 citations
  35. Galactica: A Large Language Model for ScienceRoss Taylor, Marcin Kardas, Guillem Cucurull, et al.2022 · 558 citations
  36. Precise Zero-Shot Dense Retrieval without Relevance LabelsLuyu Gao, Xueguang Ma, Jimmy Lin, et al.2022 · 545 citations
  37. Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model ParametersCharlie Snell, Jaehoon Lee, Kelvin Xu, et al.2024 · 524 citations
  38. Baichuan 2: Open Large-scale Language ModelsAiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 512 citations
  39. REPLUG: Retrieval-Augmented Black-Box Language ModelsWeijia Shi, Sewon Min, Michihiro Yasunaga, et al.2023 · 482 citations
  40. LLM-Pruner: On the Structural Pruning of Large Language ModelsXinyin Ma, Gongfan Fang, Xinchao Wang2023 · 447 citations
  41. GPT-NER: Named Entity Recognition via Large Language ModelsShuhe Wang, Xiaofei Sun, Xiaoya Li, et al.2025 · 436 citations
  42. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  43. C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation ModelsYuzhen Huang, Yuzhuo Bai, Zhihao Zhu, et al.2023 · 427 citations
  44. Kimi k1.5: Scaling Reinforcement Learning with LLMsKimi Team, Angang Du, Bofei Gao, et al.2025 · 413 citations
  45. The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleGuilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 404 citations
  46. AgentBench: Evaluating LLMs as AgentsXiao Liu, Hao Yu, Hanchen Zhang, et al.2023 · 404 citations
  47. Yi: Open Foundation Models by 01.AIAlex Young, Bei Chen, Chao Li, et al.2024 · 402 citations
  48. Editing Models with Task ArithmeticGabriel Ilharco, Marco Tulio Ribeiro, Mitchell Wortsman, et al.2022 · 374 citations
  49. Llama Guard: LLM-based Input-Output Safeguard for Human-AI ConversationsHakan Inan, Kartikeya Upasani, Jianfeng Chi, et al.2023 · 369 citations
  50. VILA: On Pre-training for Visual Language ModelsJi Lin, Hongxu Yin, Wei Ping, et al.2023 · 367 citations
  51. A Survey on Large Language Models for Code GenerationJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 366 citations
  52. Augmented Language Models: a SurveyGrégoire Mialon, Roberto Dessì, Maria Lomeli, et al.2023 · 362 citations
  53. TinyLlama: An Open-Source Small Language ModelPeiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 350 citations
  54. Improving alignment of dialogue agents via targeted human judgementsAmelia Glaese, Nat McAleese, Maja Trębacz, et al.2022 · 346 citations
  55. PaLI: A Jointly-Scaled Multilingual Language-Image ModelXi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 339 citations
  56. Solving math word problems with process- and outcome-based feedbackJonathan Uesato, Nate Kushman, Ramana Kumar, et al.2022 · 334 citations
  57. MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesWeihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 328 citations
  58. Are Emergent Abilities of Large Language Models a Mirage?Rylan Schaeffer, Brando Miranda, Sanmi Koyejo2023 · 323 citations
  59. MEDITRON-70B: Scaling Medical Pretraining for Large Language ModelsZeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.2023 · 307 citations
  60. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)Zhengyuan Yang, Linjie Li, Kevin Lin, et al.2023 · 303 citations
  61. PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial PromptsKaijie Zhu, Jindong Wang, Jiaheng Zhou, et al.2023 · 301 citations
  62. Can language models learn from explanations in context?Andrew Lampinen, Ishita Dasgupta, Stephanie Chan, et al.2022 · 288 citations
  63. Generate rather than Retrieve: Large Language Models are Strong Context GeneratorsWenhao Yu, Dan Iter, Shuohang Wang, et al.2022 · 280 citations
  64. LLM-QAT: Data-Free Quantization Aware Training for Large Language ModelsZechun Liu, Barlas Oguz, Changsheng Zhao, et al.2024 · 275 citations
  65. Llemma: An Open Language Model For MathematicsZhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 275 citations
  66. Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding HeadsTianle Cai, Yuhong Li, Zhengyang Geng, et al.2024 · 271 citations
  67. MiniCPM-V: A GPT-4V Level MLLM on Your PhoneYuan Yao, Tianyu Yu, Ao Zhang, et al.2024 · 267 citations
  68. MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training StrategiesShengding Hu, Yuge Tu, Xu Han, et al.2024 · 258 citations
  69. GPT-RE: In-context Learning for Relation Extraction using Large Language ModelsZhen Wan, Fei Cheng, Zhuoyuan Mao, et al.2023 · 252 citations
  70. Scaling Relationship on Learning Mathematical Reasoning with Large Language ModelsZheng Yuan, Hongyi Yuan, Chengpeng Li, et al.2023 · 252 citations
  71. Large Language Monkeys: Scaling Inference Compute with Repeated SamplingBradley Brown, Jordan Juravsky, Ryan Ehrlich, et al.2024 · 241 citations
  72. RAFT: Reward rAnked FineTuning for Generative Foundation Model AlignmentHanze Dong, Wei Xiong, Deepanshu Goyal, et al.2023 · 239 citations
  73. TrustLLM: Trustworthiness in Large Language ModelsYue Huang, Lichao Sun, Haoran Wang, et al.2024 · 226 citations
  74. Specializing Smaller Language Models towards Multi-Step ReasoningYao Fu, Hao Peng, Litu Ou, et al.2023 · 222 citations
  75. Beyond neural scaling laws: beating power law scaling via data pruningBen Sorscher, Robert Geirhos, Shashank Shekhar, et al.2022 · 220 citations
  76. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsNeha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 217 citations
  77. Distilling Reasoning Capabilities into Smaller Language ModelsKumar Shridhar, Alessandro Stolfo, Mrinmaya Sachan2023 · 216 citations
  78. Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LunchLe Yu, Bowen Yu, Haiyang Yu, et al.2023 · 209 citations
  79. PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about ChangeKarthik Valmeekam, Matthew Marquez, Alberto Olmo, et al.2022 · 209 citations
  80. mGPT: Few-Shot Learners Go MultilingualOleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
  81. TinyStories: How Small Can Language Models Be and Still Speak Coherent English?Ronen Eldan, Yuanzhi Li2023 · 202 citations
  82. Autoformalization with Large Language ModelsYuhuai Wu, Albert Q. Jiang, Wenda Li, et al.2022 · 202 citations
  83. A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsMd Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.2023 · 198 citations
  84. Scalable Extraction of Training Data from (Production) Language ModelsMilad Nasr, Nicholas Carlini, Jonathan Hayase, et al.2023 · 197 citations
  85. RRHF: Rank Responses to Align Language Models with Human Feedback without tearsZheng Yuan, Hongyi Yuan, Chuanqi Tan, et al.2023 · 194 citations
  86. MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningJun Chen, Deyao Zhu, Xiaoqian Shen, et al.2023 · 192 citations
  87. RAPTOR: Recursive Abstractive Processing for Tree-Organized RetrievalParth Sarthi, Salman Abdullah, Aditi Tuli, et al.2024 · 191 citations
  88. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsHugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 183 citations
  89. Knowledge Conflicts for LLMs: A SurveyRongwu Xu, Zehan Qi, Zhijiang Guo, et al.2024 · 179 citations
  90. Effective Long-Context Scaling of Foundation ModelsWenhan Xiong, Jingyu Liu, Igor Molybog, et al.2023 · 177 citations
  91. Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsShengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 173 citations
  92. SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelLoubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 171 citations
  93. OpenChat: Advancing Open-source Language Models with Mixed-Quality DataGuan Wang, Sijie Cheng, Xianyuan Zhan, et al.2023 · 171 citations
  94. Learning to Compress Prompts with Gist TokensJesse Mu, Xiang Lisa Li, Noah Goodman2023 · 170 citations
  95. SqueezeLLM: Dense-and-Sparse QuantizationSehoon Kim, Coleman Hooper, Amir Gholami, et al.2023 · 168 citations
  96. ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectXin Men, Mingyu Xu, Qingyu Zhang, et al.2024 · 167 citations
  97. Binding Language Models in Symbolic LanguagesZhoujun Cheng, Tianbao Xie, Peng Shi, et al.2022 · 165 citations
  98. Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, et al.2025 · 164 citations
  99. DataComp-LM: In search of the next generation of training sets for language modelsJeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 156 citations
  100. HunyuanVideo: A Systematic Framework For Large Video Generative ModelsWeijie Kong, Qi Tian, Zijian Zhang, et al.2024 · 155 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/