Aastha Jhunjhunwala
Aastha Jhunjhunwala has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining, Reasoning; often with Ayush Dattagupta, Chen Zhu, Dan Su.
OpenAlex · h-index 5 · 17 works · 137 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 142 times in our library · ⭐ Paper Stars ranking: #9935
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 worksMaterials Science · 1 workMaterials Chemistry · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workReasoning · 1 work
Works by year
2020s
Papers
- Nemotron-4 15B Technical Report (2024 · 30 citations)
NVIDIA set out to build the strongest general-purpose LLM that fits on a single A100 or H100 GPU. Following the Chinchilla-inspired idea of spending compute on more data rather than more parameters, the authors trained a 15B-parameter decoder-only Transformer on 8 trillion tokens. The mix was about 70% English, 15%… - OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery (2025 · 13 citations)
General-purpose LLMs often lack the specialized vocabulary and multi-step reasoning that scientific problems require. Training a science model from scratch is very costly. The authors, from SES AI and NVIDIA, instead adapt LLaMA 3.1 70B in three stages:
Co-authors here
- Ayush Dattagupta
- Chen Zhu
- Dan Su
- Deepak Narayanan
- Joseph Jennings
- Jupinder Parmar
- Kai Liu
- Mostofa Patwary
- Sandeep Subramanian
- Shrimai Prabhumoye
- Yao-Ting Wang
- Zihan Wang
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/aastha-jhunjhunwala/