Elamur Research⌕
☰
home / authors / Ian Magnusson / cited by

Who cites Ian Magnusson

909 citations of their works from 718 papers of our library (of the 149,439 whose bibliographies we read) · 183 with a page here, the most cited first · page 1 of 2 · 1–100 · ← Ian Magnusson

1 2

  1. The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
  2. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
  3. LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yaowei Zheng, Richong Zhang, Junhao Zhang, et al.2024 · 1,048 citations
  4. s1: Simple test-time scalingConference on Empirical Methods in Natural Language Processing (EMNLP)Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 608 citations
  5. The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleConference on Neural Information Processing Systems (NeurIPS)Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 434 citations
  6. Tulu 3: Pushing Frontiers in Open Language Model Post-TrainingarXiv:2411.15124Nathan Lambert, Jacob Morrison, Valentina Pyatkin, et al.2024 · 423 citations
  7. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferencearXiv:2412.13663Benjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 358 citations
  8. InternLM2 Technical ReportarXiv:2403.17297Zheng Cai, Maosong Cao, Haojiong Chen, et al.2024 · 301 citations
  9. xLSTM: Extended Long Short-Term MemoryConference on Neural Information Processing Systems (NeurIPS)Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.2024 · 296 citations
  10. MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training StrategiesarXiv:2404.06395Shengding Hu, Yuge Tu, Xu Han, et al.2024 · 269 citations
  11. RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
  12. Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelarXiv:2402.07827Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 253 citations
  13. WildChat: 1M ChatGPT Interaction Logs in the WildarXiv:2405.01470Wenting Zhao, Xiang Ren, Jack Hessel, et al.2024 · 239 citations
  14. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
  15. Aya Dataset: An Open-Access Collection for Multilingual Instruction TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Shivalika Singh, Freddie Vargus, Daniel D'souza, et al.2024 · 207 citations
  16. How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Zeng, Hongpeng Lin, Jingwen Zhang, et al.2024 · 202 citations
  17. DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
  18. SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
  19. BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex InstructionsarXiv:2406.15877Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, et al.2024 · 176 citations
  20. Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
  21. A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
  22. Moshi: a speech-text foundation model for real-time dialoguearXiv:2410.00037Alexandre Defossez, Laurent Mazare, Manu Orsini, et al.2024 · 157 citations
  23. LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation TasksarXiv:2406.18403Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, et al.2024 · 141 citations
  24. Investigating Data Contamination in Modern Benchmarks for Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chunyuan Deng, Yilun Zhao, Xiangru Tang, et al.2024 · 137 citations
  25. Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
  26. Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
  27. OpenThoughts: Data Recipes for Reasoning ModelsarXiv:2506.04178Etash Guha, Ryan Marten, Sedrick Keh, et al.2025 · 122 citations
  28. SaulLM-7B: A pioneering Large Language Model for LawarXiv:2403.03883Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, et al.2024 · 119 citations
  29. ALLaM: Large Language Models for Arabic and EnglisharXiv:2407.15390M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
  30. FineWeb2: One Pipeline to Scale Them All — Adapting Pre-Training Data Processing to Every LanguagearXiv:2506.20920Guilherme Penedo, Hynek Kydliček, Vinko Sabolčec, et al.2025 · 99 citations
  31. The Platonic Representation HypothesisarXiv:2405.07987Minyoung Huh, Brian Cheung, Tongzhou Wang, et al.2024 · 96 citations
  32. A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
  33. What's In My Big Data?arXiv:2310.20707Yanai Elazar, Akshita Bhagia, Ian Magnusson, et al.2023 · 92 citations
  34. Dream 7B: Diffusion Large Language ModelsarXiv:2508.15487Jiacheng Ye; Zhihui Xie; Lin Zheng; Jiahui Gao; Zirui Wu; Xin Jiang; Zhenguo Li;, Lingpeng Kong2025 · 89 citations
  35. How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
  36. Mapping the Increasing Use of LLMs in Scientific PapersarXiv:2404.01268Weixin Liang, Yaohui Zhang, Zhengxuan Wu, et al.2024 · 89 citations
  37. Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
  38. Do Membership Inference Attacks Work on Large Language Models?arXiv:2402.07841Michael Duan, Anshuman Suri, Niloofar Mireshghallah, et al.2024 · 87 citations
  39. Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
  40. OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction DataarXiv:2410.01560Shubham Toshniwal, Wei Du, Ivan Moshkov, et al.2024 · 85 citations
  41. OpenCoder: The Open Cookbook for Top-Tier Code Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Siming Huang, Tianhao Cheng, Jason Klein Liu, et al.2025 · 81 citations
  42. Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionarXiv:2404.07143Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal2024 · 80 citations
  43. BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextarXiv:2403.18421Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, et al.2024 · 79 citations
  44. Reinforcement Learning via Self-DistillationarXiv:2601.20802Jonas Hubotter, Frederike Lubeck, Lejs Behric, et al.2026 · 74 citations
  45. QuRating: Selecting High-Quality Data for Training Language ModelsarXiv:2402.09739Alexander Wettig, Aatmik Gupta, Saumya Malik, et al.2024 · 74 citations
  46. A Primer on the Inner Workings of Transformer-based Language ModelsarXiv:2405.00208Javier Ferrando, Gabriele Sarti, Arianna Bisazza, et al.2024 · 72 citations
  47. VeriScore: Evaluating the factuality of verifiable claims in long-form text generationFindings of the Association for Computational LinguisticsYixiao Song, Yekyung Kim, Mohit Iyyer2024 · 72 citations
  48. Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
  49. Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
  50. OpenMoE: An Early Effort on Open Mixture-of-Experts Language ModelsarXiv:2402.01739Fuzhao Xue, Zian Zheng, Yao Fu, et al.2024 · 64 citations
  51. Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion TokensarXiv:2401.17377Jiacheng Liu, Sewon Min, Luke Zettlemoyer, et al.2024 · 62 citations
  52. OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMsarXiv:2411.14199Akari Asai, Jacqueline He, Rulin Shao, et al.2024 · 62 citations
  53. mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
  54. ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Mingjie Liu, Shizhe Diao, Ximing Lu, et al.2025 · 58 citations
  55. RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492Qian Liu, Xiaosen Zheng, Niklas Muennighoff, et al.2024 · 57 citations
  56. Tokenization counts: the impact of tokenization on arithmetic in frontier LLMsarXiv:2402.14903Aaditya K. Singh, DJ Strouse2024 · 55 citations
  57. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
  58. The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce HarmConference on Empirical Methods in Natural Language Processing (EMNLP)Aakanksha, Arash Ahmadian, Beyza Ermis, et al.2024 · 49 citations
  59. Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
  60. Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
  61. Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations
  62. olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language ModelsarXiv:2502.18443Jake Poznanski, Aman Rangapur, Jon Borchardt, et al.2025 · 44 citations
  63. Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Sander Land, Max Bartolo2024 · 42 citations
  64. Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
  65. Auxiliary task demands mask the capabilities of smaller language modelsarXiv:2404.02418Jennifer Hu, Michael C. Frank2024 · 41 citations
  66. FollowIR: Evaluating and Teaching Information Retrieval Models to Follow InstructionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Orion Weller, Benjamin Chang, Sean MacAvaney, et al.2025 · 40 citations
  67. CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language PromptingarXiv:2404.10199Huihan Li, Liwei Jiang, Jena D. Hwang, et al.2024 · 40 citations
  68. SlimPajama-DC: Understanding Data Combinations for LLM TrainingarXiv:2309.10818Zhiqiang Shen, Tianhua Tao, Liqun Ma, et al.2023 · 38 citations
  69. On the Diversity of Synthetic Data and its Impact on Training Large Language ModelsarXiv:2410.15226Hao Chen, Abdul Waheed, Xiang Li, et al.2024 · 35 citations
  70. Benchmarking Linguistic Diversity of Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yanzhu Guo, Guokan Shang, Chloé Clavel2025 · 32 citations
  71. Detection and Measurement of Syntactic Templates in Generated TextConference on Empirical Methods in Natural Language Processing (EMNLP)Chantal Shaib, Yanai Elazar, Junyi Jessy Li, et al.2024 · 32 citations
  72. SEA-LION: Southeast Asian Languages in One NetworkInternational Joint Conference on Natural Language Processing (IJCNLP)Raymond Ng, Thanh Ngan Nguyen, Huang Yuli, et al.2025 · 29 citations
  73. Towards Effective and Efficient Continual Pre-training of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Chen, Zhipeng Chen, Jiapeng Wang, et al.2025 · 29 citations
  74. NovelQA: Benchmarking Question Answering on Documents Exceeding 200K TokensarXiv:2403.12766Cunxiang Wang, Ruoxi Ning, Boqi Pan, et al.2024 · 29 citations
  75. Baichuan-Omni-1.5 Technical ReportarXiv:2501.15368Yadong Li, Jun Liu, Tao Zhang, et al.2025 · 28 citations
  76. Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
  77. JetMoE: Reaching Llama2 Performance with 0.1M DollarsarXiv:2404.07413Yikang Shen, Zhen Guo, Tianle Cai, et al.2024 · 28 citations
  78. Do Large Language Models have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yanzhu Guo, Simone Conia, Zelin Zhou, et al.2025 · 25 citations
  79. Aligning LLMs with Individual Preferences via InteractionInternational Conference on Computational Linguistics (COLING)Shujin Wu, Yi R. Fung, Cheng Qian, et al.2025 · 24 citations
  80. IberoBench: A Benchmark for LLM Evaluation in Iberian LanguagesInternational Conference on Computational Linguistics (COLING)Irene Baucells, Javier Aula-Blasco, Iria de-Dios-Flores, et al.2025 · 24 citations
  81. A Survey of Large Language Models for Arabic Language and its DialectsACM Transactions on Asian and Low-Resource Language Information ProcessingMalak Mashaabi, Shahad Al-Khalifa, Hend Al-Khalifa2024 · 24 citations
  82. An Expanded Massive Multilingual Dataset for High-Performance Language Technologies (HPLT)Annual Meeting of the Association for Computational Linguistics (ACL)Laurie Burchell, Ona de Gibert, Nikolay Arefyev, et al.2025 · 23 citations
  83. RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
  84. HALoGEN: Fantastic LLM Hallucinations and Where to Find ThemAnnual Meeting of the Association for Computational Linguistics (ACL)Abhilasha Ravichander, Shrusti Ghela, David Wadden, et al.2025 · 22 citations
  85. NeoBERT: A Next-Generation BERTarXiv:2502.19587Lola Le Breton, Quentin Fournier, Mariam El Mezouar, et al.2025 · 20 citations
  86. Baichuan-Omni Technical ReportarXiv:2410.08565Yadong Li, Haoze Sun, Mingan Lin, et al.2024 · 18 citations
  87. Dataset Decomposition: Faster LLM Training with Variable Sequence Length CurriculumConference on Neural Information Processing Systems (NeurIPS)Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.2024 · 16 citations
  88. AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data FiltersAnnual Meeting of the Association for Computational Linguistics (ACL)Li Lucy, Suchin Gururangan, Luca Soldaini, et al.2024 · 15 citations
  89. Dolomites: Domain-Specific Long-Form Methodical TasksTransactions of the Association for Computational Linguistics (TACL)Chaitanya Malaviya, Priyanka Agrawal, Kuzman Ganchev, et al.2025 · 12 citations
  90. Benchmarking LLaMA-3 on Arabic Language Generation TasksArabic Natural Language Processing Conference (ArabicNLP)Md Tawkat Islam Khondaker, Numaan Naeem, Fatimah Khan, et al.2024 · 12 citations
  91. Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
  92. MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
  93. How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?Computational LinguisticsAtsuki Yamaguchi, Aline Villavicencio, Nikolaos Aletras2026 · 11 citations
  94. Multiple LLM Agents Debate for Equitable Cultural AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL)Dayeon Ki, Rachel Rudinger, Tianyi Zhou, et al.2025 · 10 citations
  95. Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation FrameworkConference on Empirical Methods in Natural Language Processing (EMNLP)Mohna Chakraborty, Lu Wang, David Jurgens2025 · 9 citations
  96. TESS 2: A Large-Scale Generalist Diffusion Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Jaesung Tae, Hamish Ivison, Sachin Kumar, et al.2025 · 9 citations
  97. CER: Confidence Enhanced Reasoning in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Ali Razghandi, Seyed Mohammad Hadi Hosseini, Mahdieh Soleymani Baghshah2025 · 8 citations
  98. Nudging: Inference-time Alignment of LLMs via Guided DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Fei, Yasaman Razeghi, Sameer Singh2025 · 8 citations
  99. Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning AnalysisArabic Natural Language Processing Conference (ArabicNLP)Sabri Boughorbel, Md Rizwan Parvez, Majd Hawasly2024 · 8 citations
  100. Scaling Smart: Accelerating Large Language Model Pre-training with Small Model InitializationarXiv:2409.12903Mohammad Samragh, Iman Mirzadeh, Keivan Alizadeh Vahid, et al.2024 · 8 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/ian-magnusson/cited-by/