Gaurav Mishra
Gaurav Mishra has 2 papers in our library, in 2022, most of them on Language models & pretraining; often with Adam Roberts, Hyung Won Chung, Sharan Narang.
OpenAlex · ORCID · h-index 12 · 63 works · 5,124 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 9,492 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #724
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
💡 Concepts 3Key ideas and methods explained on our concept pages.Few-shot learning · 1 workLanguage model · 1 workLarge language models · 1 work
Works by year
2020s
Papers
- PaLM: Scaling Language Modeling with Pathways (2022 · 4,753 citations)
This paper asks whether making a dense Transformer language model much larger still improves few-shot learning, where a model solves a task from a short prompt and a few examples instead of being finetuned. - Scaling Up Models and Data with t5x and seqio (2022 · 130 citations)
Training language models with hundreds of billions of parameters usually requires custom, hand-tuned infrastructure. That slows down experimentation and makes fair comparisons between models difficult. This paper presents two open-source Google libraries meant to lower that barrier.
All works
- PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
- Scaling Instruction-Finetuned Language Models ↗arXiv:2210.11416 · no summary yetHyung Won Chung et al.2022 · 3,392 citations
- Scaling Up Models and Data with t5x and seqioarXiv:2203.17189Adam Roberts, Hyung Won Chung, Anselm Levskaya, et al.2022 · 130 citations
Co-authors here
- Adam Roberts ×2
- Hyung Won Chung ×2
- Sharan Narang ×2
- Aakanksha Chowdhery
- Afroz Mohiuddin
- Aitor Lewkowycz
- Anselm Levskaya
- Brian Lester
- Charles Sutton
- Daniel Andor
- Jacob Devlin
- James Bradbury
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/gaurav-mishra/