Giri Anantharaman
Giri Anantharaman has 2 papers in our library, in 2021, most of them on Language models & pretraining, Multilingual & cross-lingual NLP; often with Jingfei Du, Myle Ott, Naman Goyal.
OpenAlex · h-index 2 · 6 works · 97 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 177 times in our library · ⭐ Paper Stars ranking: #5760
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksMultilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- Larger-Scale Transformers for Multilingual Masked Language Modeling (2021 · 161 citations)
Multilingual masked language models like XLM-R help low-resource languages. However, splitting limited capacity across many languages tends to hurt results on high-resource ones. This paper tests whether a much larger model removes that trade-off. - Efficient Large Scale Language Modeling with Mixtures of Experts (2021 · 113 citations)
Making language models larger reliably improves them, but the training cost limits who can do it and raises energy concerns.
Co-authors here
- Jingfei Du ×2
- Myle Ott ×2
- Naman Goyal ×2
- Alexis Conneau
- Mikel Artetxe
- Ramakanth Pasunuru
- Sam Shleifer
- Shruti Bhosale
- Srinivasan Iyer
- Todor Mihaylov
- Xi Victoria Lin
- Xian Li
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/giri-anantharaman/