Jupinder Parmar
Jupinder Parmar has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Mostofa Patwary, Ayush Dattagupta, Bryan Catanzaro.
OpenAlex · h-index 3 · 18 works · 40 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 341 times in our library · ⭐ Paper Stars ranking: #7413
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models (2024 · 36 citations)
Pretraining large language models from scratch now costs so much that few teams can repeat it each time a stronger competitor appears. - Nemotron-4 15B Technical Report (2024 · 30 citations)
NVIDIA set out to build the strongest general-purpose LLM that fits on a single A100 or H100 GPU. Following the Chinchilla-inspired idea of spending compute on more data rather than more parameters, the authors trained a 15B-parameter decoder-only Transformer on 8 trillion tokens. The mix was about 70% English, 15%…
Co-authors here
- Mostofa Patwary ×2
- Ayush Dattagupta
- Bryan Catanzaro
- Chen Zhu
- Dan Su
- Joseph Jennings
- Mohammad Shoeybi
- Sandeep Subramanian
- Shrimai Prabhumoye
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jupinder-parmar/