Elamur Research⌕
☰
home / authors / Mohammad Shoeybi / all works

Mohammad Shoeybi — all works

26 works · ← Mohammad Shoeybi

  1. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
  2. VILA: On Pre-training for Visual Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJi Lin, Hongxu Yin, Wei Ping, et al.2023 · 381 citations
  3. Reducing Activation Recomputation in Large Transformer ModelsarXiv:2205.05198Vijay Korthikanti, Jared Casper, Sangkug Lym, et al.2022 · 273 citations
  4. NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding ModelsarXiv:2405.17428Chankyu Lee, Rajarshi Roy, Mengyao Xu, et al.2024 · 222 citations
  5. Training Question Answering Models From Synthetic DataConference on Empirical Methods in Natural Language Processing (EMNLP)Raul Puri, Ryan Spring, Mohammad Shoeybi, et al.2020 · 208 citations
  6. Factuality Enhanced Language Models for Open-Ended Text Generation ↗arXiv:2206.04624 · no summary yetNayeon Lee et al.2022 · 168 citations
  7. MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Peng Xu, Mostofa Patwary, Mohammad Shoeybi, et al.2020 · 158 citations
  8. BioMegatron: Larger Biomedical Domain Language Model ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetHoo-Chang Shin et al.2020 · 155 citations
  9. Retrieval meets Long Context Large Language ModelsarXiv:2310.03025Peng Xu, Wei Ping, Xianchao Wu, et al.2023 · 130 citations
  10. End-to-End Training of Neural Retrievers for Open-Domain Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Devendra Sachan, Mostofa Patwary, Mohammad Shoeybi, et al.2021 · 116 citations
  11. An Empirical Study of Mamba-based Language Models ↗arXiv:2406.07887 · no summary yetRoger Waleffe et al.2024 · 67 citations
  12. Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
  13. ChatQA: Surpassing GPT-4 on Conversational QA and RAGConference on Neural Information Processing Systems (NeurIPS)Zihan Liu, Wei Ping, Rajarshi Roy, et al.2024 · 58 citations
  14. NVLM: Open Frontier-Class Multimodal LLMsarXiv:2409.11402Wenliang Dai, Nayeon Lee, Boxin Wang, et al.2024 · 44 citations
  15. Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning ↗Findings of the Association for Computational Linguistics: EMNLP 2023 · no summary yetZhuolin Yang et al.2023 · 44 citations
  16. ODIN: Disentangled Reward Mitigates Hacking in RLHF ↗arXiv:2402.07319 · no summary yetLichang Chen et al.2024 · 38 citations
  17. AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling ↗Findings of the Association for Computational Linguistics: ACL 2025 · no summary yetZihan Liu et al.2025 · 37 citations
  18. Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language ModelsarXiv:2407.07263Jupinder Parmar, Sanjev Satheesh, Mostofa Patwary, et al.2024 · 36 citations
  19. AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning ↗arXiv:2505.16400 · no summary yetYang Chen et al.2025 · 30 citations
  20. AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL SynergyarXiv:2506.13284Zihan Liu, Zhuolin Yang, Yang Chen, et al.2025 · 21 citations
  21. Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
  22. MIND: Math Informed syNthetic Dialogues for Pretraining LLMs ↗arXiv:2410.12881 · no summary yetSyeda Nahida Akter et al.2024 · 11 citations
  23. Nemotron-CrossThink: Scaling Self-Learning beyond Math ReasoningConference of the European Chapter of the Association for Computational Linguistics (EACL)Syeda Nahida Akter, Shrimai Prabhumoye, Matvei Novikov, et al.2026 · 9 citations
  24. Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data ↗arXiv:2510.03264 · no summary yetSyeda Nahida Akter et al.2025 · 6 citations
  25. From 128K to 4M: Efficient Training of Ultra-Long Context Large Language ModelsFindings of the Association for Computational LinguisticsChejian Xu, Wei Ping, Peng Xu, et al.2026 · 5 citations
  26. Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models ↗arXiv (Cornell University) · no summary yetTan Yu et al.2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/mohammad-shoeybi/works/