Elamur Research⌕
☰
home / authors / Vaishaal Shankar / cited by

Who cites Vaishaal Shankar

618 citations of their works from 546 papers of our library (of the 149,439 whose bibliographies we read) · 125 with a page here, the most cited first · page 1 of 2 · 1–100 · ← Vaishaal Shankar

1 2

  1. Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
  2. The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
  3. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  4. LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,485 citations
  5. Qwen2.5-VL Technical ReportarXiv:2502.13923Shuai Bai, Keqin Chen, Xuejing Liu, et al.2025 · 1,031 citations
  6. Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and BeyondarXiv:2308.12966Jinze Bai, Shuai Bai, Shusheng Yang, et al.2023 · 970 citations
  7. Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any ResolutionarXiv:2409.12191Peng Wang, Shuai Bai, Sinan Tan, et al.2024 · 860 citations
  8. Reproducible scaling laws for contrastive language-image learningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 769 citations
  9. s1: Simple test-time scalingConference on Empirical Methods in Natural Language Processing (EMNLP)Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 608 citations
  10. ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLecture notes in computer scienceLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 454 citations
  11. Kimi k1.5: Scaling Reinforcement Learning with LLMsarXiv:2501.12599Kimi Team, Angang Du, Bofei Gao, et al.2025 · 431 citations
  12. Tool Learning with Foundation ModelsACM Computing SurveysYujia Qin, Shengding Hu, Yankai Lin, et al.2023 · 383 citations
  13. Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionShengbang Tong, Zhuang Liu, Yuexiang Zhai, et al.2024 · 321 citations
  14. MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
  15. RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
  16. DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT ModelsConference on Neural Information Processing Systems (NeurIPS)Boxin Wang, Weixin Chen, Hengzhi Pei, et al.2023 · 259 citations
  17. Beyond neural scaling laws: beating power law scaling via data pruningConference on Neural Information Processing Systems (NeurIPS)Ben Sorscher, Robert Geirhos, Shashank Shekhar, et al.2022 · 231 citations
  18. DataComp: In search of the next generation of multimodal datasetsConference on Neural Information Processing Systems (NeurIPS)Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, et al.2023 · 224 citations
  19. Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Shengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 208 citations
  20. Large Language Model as Attributed Training Data Generator: A Tale of Diversity and BiasConference on Neural Information Processing Systems (NeurIPS)Yue Yu, Yuchen Zhuang, Jieyu Zhang, et al.2023 · 202 citations
  21. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
  22. DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
  23. SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
  24. Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language ModelsScience China Information SciencesQiguang Chen, Libo Qin, Jinhao Liu, et al.2025 · 176 citations
  25. On the Robustness of ChatGPT: An Adversarial and Out-of-distribution PerspectivearXiv:2302.12095Jindong Wang, Xixu Hu, Wenxin Hou, et al.2023 · 176 citations
  26. A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
  27. Measure and Improve Robustness in NLP Models: A SurveyConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Xuezhi Wang, Haohan Wang, Diyi Yang2022 · 148 citations
  28. Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
  29. Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
  30. OpenThoughts: Data Recipes for Reasoning ModelsarXiv:2506.04178Etash Guha, Ryan Marten, Sedrick Keh, et al.2025 · 122 citations
  31. FineWeb2: One Pipeline to Scale Them All — Adapting Pre-Training Data Processing to Every LanguagearXiv:2506.20920Guilherme Penedo, Hynek Kydliček, Vinko Sabolčec, et al.2025 · 99 citations
  32. Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language ModelsarXiv:2601.18734Siyan Zhao, Zhihui Xie, Mengchen Liu, et al.2026 · 97 citations
  33. GLM-5: from Vibe Coding to Agentic EngineeringarXiv:2602.15763Aohan Zeng, Xin Lv, Zhenyu Hou, et al.2026 · 95 citations
  34. A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
  35. Rephrasing the Web: A Recipe for Compute and Data-Efficient Language ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Pratyush Maini, Skyler Seto, Richard Bai, et al.2024 · 90 citations
  36. Dream 7B: Diffusion Large Language ModelsarXiv:2508.15487Jiacheng Ye; Zhihui Xie; Lin Zheng; Jiahui Gao; Zirui Wu; Xin Jiang; Zhenguo Li;, Lingpeng Kong2025 · 89 citations
  37. GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement LearningarXiv:2507.01006GLM-V Team, Wenyi Hong, Wenmeng Yu, et al.2025 · 89 citations
  38. How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
  39. Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
  40. Reinforcement Learning via Self-DistillationarXiv:2601.20802Jonas Hubotter, Frederike Lubeck, Lejs Behric, et al.2026 · 74 citations
  41. Kimi-VL Technical ReportarXiv:2504.07491Kimi Team, Angang Du, Bohong Yin, et al.2025 · 70 citations
  42. Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
  43. Seed1.5-VL Technical ReportarXiv:2505.07062Dong Guo, Faming Wu, Feida Zhu, et al.2025 · 67 citations
  44. Kimi K2.5: Visual Agentic IntelligencearXiv:2602.02276Kimi Team, Tongtong Bai, Yifan Bai, et al.2026 · 66 citations
  45. Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
  46. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
  47. Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
  48. mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language ModelsarXiv:2408.04840Jiabo Ye, Haiyang Xu, Haowei Liu, et al.2024 · 60 citations
  49. mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
  50. Rho-1: Not All Tokens Are What You NeedarXiv:2404.07965Zhenghao Lin, Zhibin Gou, Yeyun Gong, et al.2024 · 59 citations
  51. Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling LawsarXiv:2401.00448Nikhil Sardana, Jacob Portes, Sasha Doubov, et al.2024 · 57 citations
  52. RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492Qian Liu, Xiaosen Zheng, Niklas Muennighoff, et al.2024 · 57 citations
  53. Teaching Arithmetic to Small TransformersarXiv:2307.03381Nayoung Lee, Kartik Sreenivasan, Jason D. Lee, et al.2023 · 57 citations
  54. CogVLM2: Visual Language Models for Image and Video UnderstandingarXiv:2408.16500Wenyi Hong, Weihan Wang, Ming Ding, et al.2024 · 52 citations
  55. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
  56. Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
  57. Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
  58. olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language ModelsarXiv:2502.18443Jake Poznanski, Aman Rangapur, Jon Borchardt, et al.2025 · 44 citations
  59. NVLM: Open Frontier-Class Multimodal LLMsarXiv:2409.11402Wenliang Dai, Nayeon Lee, Boxin Wang, et al.2024 · 44 citations
  60. Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
  61. Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
  62. Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
  63. Scaling Laws and Compute-Optimal Training Beyond Fixed Training DurationsConference on Neural Information Processing Systems (NeurIPS)Alexander Hägele, Elie Bakouch, Atli Kosson, et al.2024 · 31 citations
  64. InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language ModelsarXiv:2503.06692Yuchen Yan, Yongliang Shen, Yang Liu, et al.2025 · 29 citations
  65. Towards Effective and Efficient Continual Pre-training of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Chen, Zhipeng Chen, Jiapeng Wang, et al.2025 · 29 citations
  66. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic ReasoningarXiv:2512.20848NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, et al.2025 · 27 citations
  67. Distillation Scaling LawsarXiv:2502.08606Dan Busbridge, Amitis Shidani, Floris Weers, et al.2025 · 26 citations
  68. MegaPairs: Massive Data Synthesis for Universal Multimodal RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Junjie Zhou, Yongping Xiong, Zheng Liu, et al.2025 · 26 citations
  69. MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training RecipearXiv:2509.18154Tianyu Yu, Zefan Wang, Chongyi Wang, et al.2025 · 24 citations
  70. RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
  71. MiniCPM4: Ultra-Efficient LLMs on End DevicesarXiv:2506.07900MiniCPM Team, Chaojun Xiao, Yuxuan Li, et al.2025 · 22 citations
  72. Scaling Latent Reasoning via Looped Language ModelsarXiv:2510.25741Rui-Jie Zhu, Zixuan Wang, Kai Hua, et al.2025 · 22 citations
  73. Resolving Discrepancies in Compute-Optimal Scaling of Language ModelsConference on Neural Information Processing Systems (NeurIPS)Tomer Porian, Mitchell Wortsman, Jenia Jitsev, et al.2024 · 19 citations
  74. Baichuan-Omni Technical ReportarXiv:2410.08565Yadong Li, Haoze Sun, Mingan Lin, et al.2024 · 18 citations
  75. Dataset Decomposition: Faster LLM Training with Variable Sequence Length CurriculumConference on Neural Information Processing Systems (NeurIPS)Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.2024 · 16 citations
  76. Rethinking Reflection in Pre-TrainingarXiv:2504.04022Essential AI: Darsh J Shah, Peter Rushton, Somanshu Singla, et al.2025 · 15 citations
  77. CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal ModelsACM International Conference on Multimedia (ACM MM)Wentao Liu, Qianjun Pan, Yi Zhang, et al.2024 · 13 citations
  78. Fast and Effective On-Policy Distillation from Reasoning PrefixesFindings of the Association for Computational LinguisticsDongxu Zhang, Zhichao Yang, Sepehr Janghorbani, et al.2026 · 12 citations
  79. Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
  80. MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
  81. Beyond Random Sampling: Efficient Language Model Pretraining via Curriculum LearningConference of the European Chapter of the Association for Computational Linguistics (EACL)Yang Zhang, Amr Mohamed, Hadi Abdine, et al.2026 · 7 citations
  82. Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-ThoughtarXiv:2510.04230Guijin Son, Donghun Yang, Hitesh Laxmichand Patel, et al.2025 · 7 citations
  83. Bilingual Adaptation of Monolingual Foundation ModelsarXiv:2407.12869Gurpreet Gosal, Yishi Xu, Gokul Ramakrishnan, et al.2024 · 7 citations
  84. Arabic Stable LM: Adapting Stable LM 2 1.6B to ArabicarXiv:2412.04277Zaid Alyafeai, Michael Pieler, Hannah Teufel, et al.2024 · 6 citations
  85. PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Jingcheng Hu, Yinmin Zhang, Shijie Shang, et al.2026 · 5 citations
  86. Aleph-Alpha-GermanWeb: Improving German-language LLM pre-training with model-based data curation and synthetic data generationConference of the European Chapter of the Association for Computational Linguistics (EACL)Thomas F Burns, Letitia Parcalabescu, Stephan Waeldchen, et al.2026 · 4 citations
  87. What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Yaning Jia, Chunhui Zhang, Xingjian Diao, et al.2026 · 4 citations
  88. Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL)Yuming Yang, Mingyoung Lai, Wanxu Zhao, et al.2026 · 4 citations
  89. Controllable LLM Reasoning via Sparse Autoencoder-Based SteeringAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Fang, Wenjie Wang, Mingfeng Xue, et al.2026 · 3 citations
  90. MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data SynthesisFindings of the Association for Computational LinguisticsZixiong Yu, Jun Rao, Guhan Chen, et al.2026 · 3 citations
  91. QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented GenerationFindings of the Association for Computational LinguisticsDehai Min, Kailin Zhang, Tongtong Wu, et al.2026 · 2 citations
  92. STEP3-VL-10B Technical ReportarXiv:2601.09668Ailin Huang, Chengyuan Yao, Chunrui Han, et al.2026 · 2 citations
  93. The olmOCR Project: Building Fully Open OCR using VLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Jake Poznanski, Kyle Lo, Luca Soldaini2026 · 2 citations
  94. CAIRE: Cultural Attribution of Images with RetrievalConference of the European Chapter of the Association for Computational Linguistics (EACL)Arnav Yayavaram, Siddharth Yayavaram, Simran Khanuja, et al.2026 · 1 citation
  95. Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Kailai Yang, Xiao Liu, Lei Ji, et al.2026 · 1 citation
  96. KletterMix: Climbing Toward High-Quality German Pretraining Data - The Full ReportarXiv:2606.03773Maurice Kraus, Ruben Harle, Sebastian Sztwiertnia, et al.2026 · 1 citation
  97. Learning from Contrasts: Synthesizing Reasoning Paths from Diverse Search TrajectoriesAnnual Meeting of the Association for Computational Linguistics (ACL)Peiyang Liu, Zhirui Chen, Xi Wang, et al.2026 · 1 citation
  98. On the Step Length Confounding in LLM Reasoning Data SelectionFindings of the Association for Computational LinguisticsBing Wang, Rui Miao, Chen Shen, et al.2026 · 1 citation
  99. Reformulate and Create, Don't Translate: Creating Natural Prompts for Underserved LanguagesLanguage Resources and Evaluation Conference (LREC)Annika Simonsen, Mathias Stenlund, Lars Bungum, et al.2026 · 1 citation
  100. Revisiting Audio-language Pretraining for Learning General-purpose Audio RepresentationAnnual Meeting of the Association for Computational Linguistics (ACL)Wei-Cheng Tseng, Xuanru Zhou, Mingyue Huo, et al.2026 · 1 citation

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/vaishaal-shankar/cited-by/