Who cites Rulin Shao
- The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
- Kimi k1.5: Scaling Reinforcement Learning with LLMsarXiv:2501.12599Kimi Team, Angang Du, Bofei Gao, et al.2025 · 431 citations
- Large Language Monkeys: Scaling Inference Compute with Repeated SamplingarXiv:2407.21787Bradley Brown, Jordan Juravsky, Ryan Ehrlich, et al.2024 · 270 citations
- RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
- DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
- SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
- Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language ModelsScience China Information SciencesQiguang Chen, Libo Qin, Jinhao Liu, et al.2025 · 176 citations
- A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
- Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
- Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
- OpenThoughts: Data Recipes for Reasoning ModelsarXiv:2506.04178Etash Guha, Ryan Marten, Sedrick Keh, et al.2025 · 122 citations
- FineWeb2: One Pipeline to Scale Them All — Adapting Pre-Training Data Processing to Every LanguagearXiv:2506.20920Guilherme Penedo, Hynek Kydliček, Vinko Sabolčec, et al.2025 · 99 citations
- World Model on Million-Length Video And Language With Blockwise RingAttentionarXiv:2402.08268Hao Liu, Wilson Yan, Matei Zaharia, et al.2024 · 99 citations
- GLM-5: from Vibe Coding to Agentic EngineeringarXiv:2602.15763Aohan Zeng, Xin Lv, Zhenyu Hou, et al.2026 · 95 citations
- Dream 7B: Diffusion Large Language ModelsarXiv:2508.15487Jiacheng Ye; Zhihui Xie; Lin Zheng; Jiahui Gao; Zirui Wu; Xin Jiang; Zhenguo Li;, Lingpeng Kong2025 · 89 citations
- GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement LearningarXiv:2507.01006GLM-V Team, Wenyi Hong, Wenmeng Yu, et al.2025 · 89 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
- TTRL: Test-Time Reinforcement LearningConference on Neural Information Processing Systems (NeurIPS)Yuxin Zuo, Kaiyan Zhang, Li Sheng, et al.2025 · 76 citations
- Reinforcement Learning via Self-DistillationarXiv:2601.20802Jonas Hubotter, Frederike Lubeck, Lejs Behric, et al.2026 · 74 citations
- Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
- Reasoning with Exploration: An Entropy PerspectivearXiv:2506.14758Daixuan Cheng, Shaohan Huang, Xuekai Zhu, et al.2025 · 63 citations
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMsarXiv:2411.14199Akari Asai, Jacqueline He, Rulin Shao, et al.2024 · 62 citations
- Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Fei Wang, Xingchen Wan, Ruoxi Sun, et al.2025 · 59 citations
- mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
- Rho-1: Not All Tokens Are What You NeedarXiv:2404.07965Zhenghao Lin, Zhibin Gou, Yeyun Gong, et al.2024 · 59 citations
- Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling LawsarXiv:2401.00448Nikhil Sardana, Jacob Portes, Sasha Doubov, et al.2024 · 57 citations
- RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492Qian Liu, Xiaosen Zheng, Niklas Muennighoff, et al.2024 · 57 citations
- Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
- Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
- Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
- olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language ModelsarXiv:2502.18443Jake Poznanski, Aman Rangapur, Jon Borchardt, et al.2025 · 44 citations
- Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
- Kimi K3: Open Frontier IntelligencearXiv:2607.24653Kimi Team, Tongtong Bai, Yifan Bai, et al.2026 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning AgentsConference on Empirical Methods in Natural Language Processing (EMNLP)Qiuchen Wang, Ruixue Ding, Zehui Chen, et al.2025 · 39 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Zhepei Wei, Wenlin Yao, Yao Liu, et al.2025 · 36 citations
- Scaling Laws and Compute-Optimal Training Beyond Fixed Training DurationsConference on Neural Information Processing Systems (NeurIPS)Alexander Hägele, Elie Bakouch, Atli Kosson, et al.2024 · 31 citations
- Towards Effective and Efficient Continual Pre-training of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Chen, Zhipeng Chen, Jiapeng Wang, et al.2025 · 29 citations
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep ResearcharXiv:2511.19399Rulin Shao, Akari Asai, Shannon Zejiang Shen, et al.2025 · 28 citations
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic ReasoningarXiv:2512.20848NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, et al.2025 · 27 citations
- Distillation Scaling LawsarXiv:2502.08606Dan Busbridge, Amitis Shidani, Floris Weers, et al.2025 · 26 citations
- Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and EvaluationACM Computing SurveysSteffen Eger, Yong Cao, Jennifer D'Souza, et al.2025 · 25 citations
- RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
- MiniCPM4: Ultra-Efficient LLMs on End DevicesarXiv:2506.07900MiniCPM Team, Chaojun Xiao, Yuxuan Li, et al.2025 · 22 citations
- Scaling Latent Reasoning via Looped Language ModelsarXiv:2510.25741Rui-Jie Zhu, Zixuan Wang, Kai Hua, et al.2025 · 22 citations
- AI4Research: A Survey of Artificial Intelligence for Scientific ResearchScience China Information SciencesQiguang Chen, Mingda Yang, Libo Qin, et al.2025 · 21 citations
- SURVEYFORGE : On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey WritingAnnual Meeting of the Association for Computational Linguistics (ACL)Xiangchao Yan, Shiyang Feng, Jiakang Yuan, et al.2025 · 20 citations
- Resolving Discrepancies in Compute-Optimal Scaling of Language ModelsConference on Neural Information Processing Systems (NeurIPS)Tomer Porian, Mitchell Wortsman, Jenia Jitsev, et al.2024 · 19 citations
- ReasonRank: Empowering Passage Ranking with Strong Reasoning AbilityAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhan Liu, Xinyu Ma, Weiwei Sun, et al.2026 · 18 citations
- Dataset Decomposition: Faster LLM Training with Variable Sequence Length CurriculumConference on Neural Information Processing Systems (NeurIPS)Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.2024 · 16 citations
- Rethinking Reflection in Pre-TrainingarXiv:2504.04022Essential AI: Darsh J Shah, Peter Rushton, Somanshu Singla, et al.2025 · 15 citations
- Rewarding the Unlikely: Lifting GRPO Beyond Distribution SharpeningConference on Empirical Methods in Natural Language Processing (EMNLP)Andre Wang He, Daniel Fried, Sean Welleck2025 · 15 citations
- RaDeR: Reasoning-aware Dense Retrieval ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Debrup Das, Sam O'Nuallain, Razieh Rahimi2025 · 14 citations
- DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense RetrieversAnnual Meeting of the Association for Computational Linguistics (ACL)Xueguang Ma, Xi Victoria Lin, Barlas Oguz, et al.2025 · 13 citations
- Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
- MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
- Can LLMs Identify Critical Limitations within Scientific Research? A Systematic Evaluation on AI Research PapersAnnual Meeting of the Association for Computational Linguistics (ACL)Zhijian Xu, Yilun Zhao, Manasi Patwardhan, et al.2025 · 11 citations
- SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded TasksConference on Neural Information Processing Systems (NeurIPS)Yilun Zhao, Kaiyan Zhang, Tiansheng Hu, et al.2025 · 11 citations
- SciVer: Evaluating Foundation Models for Multimodal Scientific Claim VerificationAnnual Meeting of the Association for Computational Linguistics (ACL)Chengye Wang, Yifei Shen, Zexi Kuang, et al.2025 · 11 citations
- Diffusion vs. Autoregressive Language Models: A Text Embedding PerspectiveConference on Empirical Methods in Natural Language Processing (EMNLP)Siyue Zhang, Yilun Zhao, Liyuan Geng, et al.2025 · 10 citations
- SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific LiteratureConference of the European Chapter of the Association for Computational Linguistics (EACL)Hang Ding, Yilun Zhao, Tiansheng Hu, et al.2026 · 7 citations
- Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-ThoughtarXiv:2510.04230Guijin Son, Donghun Yang, Hitesh Laxmichand Patel, et al.2025 · 7 citations
- Bilingual Adaptation of Monolingual Foundation ModelsarXiv:2407.12869Gurpreet Gosal, Yishi Xu, Gokul Ramakrishnan, et al.2024 · 7 citations
- Arabic Stable LM: Adapting Stable LM 2 1.6B to ArabicarXiv:2412.04277Zaid Alyafeai, Michael Pieler, Hannah Teufel, et al.2024 · 6 citations
- MoNaCo: More Natural and Complex Questions for Reasoning Across Dozens of DocumentsTransactions of the Association for Computational Linguistics (TACL)Tomer Wolfson, Harsh Trivedi, Mor Geva, et al.2026 · 5 citations
- Aleph-Alpha-GermanWeb: Improving German-language LLM pre-training with model-based data curation and synthetic data generationConference of the European Chapter of the Association for Computational Linguistics (EACL)Thomas F Burns, Letitia Parcalabescu, Stephan Waeldchen, et al.2026 · 4 citations
- Test-time Corpus Feedback: From Retrieval to RAGFindings of the Association for Computational LinguisticsMandeep Rathee, Venktesh V, Sean MacAvaney, et al.2026 · 4 citations
- Agentic Rubrics as Contextual Verifiers for SWE AgentsAnnual Meeting of the Association for Computational Linguistics (ACL)Mohit Raghavendra, Anisha Gunjal, Bing Liu, et al.2026 · 3 citations
- Better LLM Reasoning via Dual-PlayFindings of the Association for Computational LinguisticsZhengxin Zhang, Chengyu Huang, Aochong Oliver Li, et al.2026 · 3 citations
- Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Wang, Hao Gu, Hongming Piao, et al.2026 · 3 citations
- Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded UpdatesAnnual Meeting of the Association for Computational Linguistics (ACL)Atsuki Yamaguchi, Terufumi Morishita, Aline Villavicencio, et al.2026 · 3 citations
- Stress Testing Factual Consistency Metrics for Long-Document SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Zain Muhammad Mujahid, Dustin Wright, Isabelle Augenstein2026 · 3 citations
- A Sovereign, Open-Source Foundation Model for German and EnglisharXiv:2607.09424Soofi-Team: Benedikt Droste, David Fitzek, Ruben Harle, et al.2026 · 2 citations
- Baichuan-M3: Modeling Clinical Inquiry for Reliable Medical Decision-MakingarXiv:2602.06570Chengfeng Dou, Fan Yang, Fei Li, et al.2026 · 2 citations
- Gained in Translation: Privileged Pairwise Judges Enhance Multilingual ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Lintang Sutawika, Gokul Swamy, Steven Wu, et al.2026 · 2 citations
- MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning ModelsFindings of the Association for Computational LinguisticsXinming Wang, Jian Xu, Bin Yu, et al.2026 · 2 citations
- QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented GenerationFindings of the Association for Computational LinguisticsDehai Min, Kailin Zhang, Tongtong Wu, et al.2026 · 2 citations
- Query Decomposition for RAG: Balancing Exploration-ExploitationConference of the European Chapter of the Association for Computational Linguistics (EACL)Roxana Petcu, Kenton Murray, Daniel Khashabi, et al.2026 · 2 citations
- The olmOCR Project: Building Fully Open OCR using VLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Jake Poznanski, Kyle Lo, Luca Soldaini2026 · 2 citations
- A Comprehensive Evaluation of Chain-of-Thought Faithfulness in Persian Classification TasksWorkshop on Language Models for Low-Resource LanguagesShakib Yazdani, Cristina España-Bonet, Eleftherios Avramidis, et al.2026 · 1 citation
- A Review of Incorporating Psychological Theories in LLMsConference of the European Chapter of the Association for Computational Linguistics (EACL)Zizhou Liu, Ziwei Gong, Lin Ai, et al.2026 · 1 citation
- AMALIA: A Fully Open Large Language Model for European PortugueseInternational Conference on Computational Processing of PortugueseAfonso Simplício, Gonçalo Vinagre, Miguel Moura Ramos, et al.2026 · 1 citation
- Among Us: Measuring and Mitigating Malicious Contributions in Model Collaboration SystemsAnnual Meeting of the Association for Computational Linguistics (ACL)Ziyuan Yang, Wenxuan Ding, Shangbin Feng, et al.2026 · 1 citation
- Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Tobias Schreieder, Tim Schopf, Michael Färber2026 · 1 citation
- BSC's Submission to the Instruction Following Track of IWSLT 2026International Conference on Spoken Language Translation (IWSLT)Oriol Pareras, Joan Llado, Pol Buitrago, et al.2026 · 1 citation
- Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Kailai Yang, Xiao Liu, Lei Ji, et al.2026 · 1 citation
- Easy Samples Are All You Need: Self-Evolving LLMs via Data-Efficient Reinforcement LearningFindings of the Association for Computational LinguisticsZhiyin Yu, Bo Zhang, Qibin Hou, et al.2026 · 1 citation
- From Interpretability to Performance: Optimizing Retrieval Heads for Long-Context Language ModelsFindings of the Association for Computational LinguisticsYoumi Ma, Naoaki Okazaki2026 · 1 citation
- IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Bosi Wen, Yilin Niu, Cunxiang Wang, et al.2026 · 1 citation
- KletterMix: Climbing Toward High-Quality German Pretraining Data - The Full ReportarXiv:2606.03773Maurice Kraus, Ruben Harle, Sebastian Sztwiertnia, et al.2026 · 1 citation
- Language Models Learn Constructional Semantics, Not To Mention Syntax: Investigating LM Understanding of Paired-Focus ConstructionsConference on Computational Natural Language Learning (CoNLL)Wesley Scivetti, Ethan Gotlieb Wilcox, Nathan Schneider, et al.2026 · 1 citation
- OLA: Output Language Alignment in Code-Switched LLM InteractionsAnnual Meeting of the Association for Computational Linguistics (ACL)Juhyun Oh, Haneul Yoo, Faiz Ghifari Haznitrama, et al.2026 · 1 citation
- Prior Beliefs Prejudice LLM-as-Judge: Evidence from Persuasion EvaluationFindings of the Association for Computational LinguisticsPardis Sadat Zahraei, Xiaoning Wang, Nimet Beyza Bozdag, et al.2026 · 1 citation
- Ready to Translate, Not to Represent? Bias and Performance Gaps in Multilingual LLMs Across Language Families and DomainsFindings of the Association for Computational LinguisticsMd. Faiyaz Abdullah Sayeedi, Subhey Sadi Rahman, Md. Mahbub Alam, et al.2026 · 1 citation
- Reasoning Up the Instruction Ladder for Controllable Language ModelsFindings of the Association for Computational LinguisticsZishuo Zheng, Vidhisha Balachandran, Chan Young Park, et al.2026 · 1 citation
- Scaling External Knowledge Input Beyond Context Windows of LLMs via Multi-Agent CollaborationAnnual Meeting of the Association for Computational Linguistics (ACL)Zijun Liu, Zhennan Wan, Peng Li, et al.2026 · 1 citation
- SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data UtilityAnnual Meeting of the Association for Computational Linguistics (ACL)Xuyang Zhi, Peilun Zhou, Chengqiang Lu, et al.2026 · 1 citation
This page in Markdown → https://md.research.elamur.ai/free/en/authors/rulin-shao/cited-by/