Joseph Jennings
Joseph Jennings has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining; often with Dan Su, Mostofa Patwary, Ayush Dattagupta.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 94 times in our library · ⭐ Paper Stars ranking: #6904
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset (2025 · 65 citations)
Leading English web corpora built from Common Crawl, such as FineWeb-Edu and DCLM, raise benchmark scores by discarding roughly nine tenths of the crawl with model-based filters. - Nemotron-4 15B Technical Report (2024 · 30 citations)
NVIDIA set out to build the strongest general-purpose LLM that fits on a single A100 or H100 GPU. Following the Chinchilla-inspired idea of spending compute on more data rather than more parameters, the authors trained a 15B-parameter decoder-only Transformer on 8 trillion tokens. The mix was about 70% English, 15%…
Co-authors here
- Dan Su ×2
- Mostofa Patwary ×2
- Ayush Dattagupta
- Brandon Norick
- Bryan Catanzaro
- Chen Zhu
- Jupinder Parmar
- Kezhi Kong
- Mohammad Shoeybi
- Sandeep Subramanian
- Shrimai Prabhumoye
- Ying Lin
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/joseph-jennings/