Brandon Norick
Brandon Norick has 2 papers in our library, in 2022–2025, most of them on Language models & pretraining, Text generation; often with Mostofa Patwary, Bryan Catanzaro, Dan Su.
OpenAlex · h-index 12 · 27 works · 2,008 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,600 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #3187
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksHardware and Architecture · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksText generation · 1 work
Works by year
2020s
Papers
- Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model (2022 · 615 citations)
The paper describes how Microsoft and NVIDIA trained Megatron-Turing NLG 530B (MT-NLG), a dense, left-to-right autoregressive transformer with 530 billion parameters. - Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset (2025 · 65 citations)
Leading English web corpora built from Common Crawl, such as FineWeb-Edu and DCLM, raise benchmark scores by discarding roughly nine tenths of the crawl with model-based filters.
All works
- Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelarXiv:2201.11990Shaden Smith, Mostofa Patwary, Brandon Norick, et al.2022 · 615 citations
- An Empirical Study of Mamba-based Language Models ↗arXiv:2406.07887 · no summary yetRoger Waleffe et al.2024 · 67 citations
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
Co-authors here
- Mostofa Patwary ×2
- Bryan Catanzaro
- Dan Su
- Jared Casper
- Joseph Jennings
- Kezhi Kong
- Mohammad Shoeybi
- Rewon Child
- Samyam Rajbhandari
- Shrimai Prabhumoye
- Vijay Korthikanti
- Ying Lin
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/brandon-norick/