🧑‍🔬 Who cites Fartash Faghri

190 citations of their works from 190 papers of our library (of the 149,439 whose bibliographies we read) · 58 with a page here, the most cited first · ← Fartash Faghri

1. The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
2. Kimi k1.5: Scaling Reinforcement Learning with LLMsarXiv:2501.12599Kimi Team, Angang Du, Bofei Gao, et al.2025 · 431 citations
3. RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
4. SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
5. A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
6. Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
7. Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
8. OpenThoughts: Data Recipes for Reasoning ModelsarXiv:2506.04178Etash Guha, Ryan Marten, Sedrick Keh, et al.2025 · 122 citations
9. FineWeb2: One Pipeline to Scale Them All — Adapting Pre-Training Data Processing to Every LanguagearXiv:2506.20920Guilherme Penedo, Hynek Kydliček, Vinko Sabolčec, et al.2025 · 99 citations
10. GLM-5: from Vibe Coding to Agentic EngineeringarXiv:2602.15763Aohan Zeng, Xin Lv, Zhenyu Hou, et al.2026 · 95 citations
11. Dream 7B: Diffusion Large Language ModelsarXiv:2508.15487Jiacheng Ye; Zhihui Xie; Lin Zheng; Jiahui Gao; Zirui Wu; Xin Jiang; Zhenguo Li;, Lingpeng Kong2025 · 89 citations
12. How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
13. Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
14. Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
15. Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
16. mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
17. Generative Reward ModelsarXiv:2410.12832Dakota Mahan, Duy Van Phung, Rafael Rafailov, et al.2024 · 58 citations
18. RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492Qian Liu, Xiaosen Zheng, Niklas Muennighoff, et al.2024 · 57 citations
19. SmolVLM: Redefining small and efficient multimodal modelsarXiv:2504.05299Andres Marafioti, Orr Zohar, Miquel Farre, et al.2025 · 56 citations
20. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
21. Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language ModelsarXiv:2406.02061Marianna Nezhurina, Lucia Cipolina-Kun, Mehdi Cherti, et al.2024 · 48 citations
22. Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
23. olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language ModelsarXiv:2502.18443Jake Poznanski, Aman Rangapur, Jon Borchardt, et al.2025 · 44 citations
24. Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language ModelsarXiv:2502.17387Alon Albalak, Duy Phung, Nathan Lile, et al.2025 · 43 citations
25. A Survey of On-Policy Distillation for Large Language ModelsarXiv:2604.00626Mingyang Song, Mao Zheng2026 · 41 citations
26. Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
27. A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to ReproducibilityarXiv:2504.07086Andreas Hochlehnert, Hardik Bhatnagar, Vishaal Udandarao, et al.2025 · 36 citations
28. Towards Effective and Efficient Continual Pre-training of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Chen, Zhipeng Chen, Jiapeng Wang, et al.2025 · 29 citations
29. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic ReasoningarXiv:2512.20848NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, et al.2025 · 27 citations
30. NaturalReasoning: Reasoning in the Wild with 2.8M Challenging QuestionsConference on Neural Information Processing Systems (NeurIPS)Weizhe Yuan, Jane Yu, Song Jiang, et al.2025 · 26 citations
31. RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
32. MiniCPM4: Ultra-Efficient LLMs on End DevicesarXiv:2506.07900MiniCPM Team, Chaojun Xiao, Yuxuan Li, et al.2025 · 22 citations
33. Scaling Latent Reasoning via Looped Language ModelsarXiv:2510.25741Rui-Jie Zhu, Zixuan Wang, Kai Hua, et al.2025 · 22 citations
34. MegaMath: Pushing the Limits of Open Math CorporaarXiv:2504.02807Fan Zhou, Zengzhi Wang, Nikhil Ranjan, et al.2025 · 19 citations
35. Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language ModelsarXiv:2412.02980Alex Havrilla, Andrew Dai, Laura O'Mahony, et al.2024 · 17 citations
36. Dataset Decomposition: Faster LLM Training with Variable Sequence Length CurriculumConference on Neural Information Processing Systems (NeurIPS)Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.2024 · 16 citations
37. Rethinking Reflection in Pre-TrainingarXiv:2504.04022Essential AI: Darsh J Shah, Peter Rushton, Somanshu Singla, et al.2025 · 15 citations
38. Rewriting Pre-Training Data Boosts LLM Performance in Math and CodearXiv:2505.02881Kazuki Fujii, Yukito Tajima, Sakae Mizuki, et al.2025 · 15 citations
39. Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
40. MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
41. BeamLoRA: Beam-Constraint Low-Rank AdaptationAnnual Meeting of the Association for Computational Linguistics (ACL)Naibin Gu, Zhenyu Zhang, Xiyu Liu, et al.2025 · 6 citations
42. Arabic Stable LM: Adapting Stable LM 2 1.6B to ArabicarXiv:2412.04277Zaid Alyafeai, Michael Pieler, Hannah Teufel, et al.2024 · 6 citations
43. Aleph-Alpha-GermanWeb: Improving German-language LLM pre-training with model-based data curation and synthetic data generationConference of the European Chapter of the Association for Computational Linguistics (EACL)Thomas F Burns, Letitia Parcalabescu, Stephan Waeldchen, et al.2026 · 4 citations
44. QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented GenerationFindings of the Association for Computational LinguisticsDehai Min, Kailin Zhang, Tongtong Wu, et al.2026 · 2 citations
45. The olmOCR Project: Building Fully Open OCR using VLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Jake Poznanski, Kyle Lo, Luca Soldaini2026 · 2 citations
46. Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Kailai Yang, Xiao Liu, Lei Ji, et al.2026 · 1 citation
47. KletterMix: Climbing Toward High-Quality German Pretraining Data - The Full ReportarXiv:2606.03773Maurice Kraus, Ruben Harle, Sebastian Sztwiertnia, et al.2026 · 1 citation
48. A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAMΔ Integration into Upcycled MoEAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Zhou, Tianhao Li, Zhijun Wang, et al.2026
49. Biomed-Enriched: Data-Efficient Biomedical Pretraining via Paragraph-Level AnnotationFindings of the Association for Computational LinguisticsRian Touchent, Nathan Godey, Éric Villemonte de la Clergerie2026
50. Dialectal Filtering: Synthesizing Kurdish Corpora for Low-Resource Varieties by Utilizing “Noise” in Large Textual DataLanguage Resources and Evaluation Conference (LREC)Christian Schuler, Raman Ahmad, Ānrán Wáng, et al.2026
51. EfficientLLM: Unified Pruning-Aware Pretraining for Auto-Designed Compact Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Xingrun Xing, Zheng Liu, Shitao Xiao, et al.2026
52. How Can Synthetic Data Improve Multilingual Language Model Pretraining? A Data Quality PerspectiveAnnual Meeting of the Association for Computational Linguistics (ACL)Tongyao Zhu, Qian Liu, Chang Ma, et al.2026
53. LEDOM: Reverse Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Xunjian Yin, Sitao Cheng, Yuxi Xie, et al.2026
54. Probing the Dynamics of Syntactic Ability Acquisition Throughout LLM PretrainingHiroshi Matsuda, Masayuki Asahara2026
55. Rewriting History: A Recipe for Interventional Analyses to Study Data Effects on Model BehaviorTransactions of the Association for Computational Linguistics (TACL)Rahul Nadkarni, Yanai Elazar, Hila Gonen, et al.2026
56. SciPedia: Unlocking the Value of Scientific Data for Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Yiwei Qin, Zhen Huang, Tiantian Mi, et al.2026
57. SELECting over Tokens: Curating Pre-training Data at Scale via Token ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Xin Tong, Weidong Zhang, Jiaang Li, et al.2026
58. Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note ScaleBioNLPJinghui Liu, Sarvesh Soni, Anthony Nguyen2026

132 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/fartash-faghri/cited-by/