Varun Gumma
Varun Gumma has 3 papers in our library, in 2023–2024, most of them on Machine translation, Language models & pretraining, Multilingual & cross-lingual NLP; often with Kalika Bali, Mohamed Ahmed, Rishav Hada.
OpenAlex · ORCID · Wikidata · h-index 6 · 33 works · 118 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 281 times in our library · ⭐ Paper Stars ranking: #4007
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 5Research subjects and languages the work is about.Machine translation · 1 workVision & language · 1 workEvaluation & benchmarks · 1 workLanguage models & pretraining · 1 workMultilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages (2023 · 200 citations)
India's 22 scheduled languages have been poorly served by machine translation. Before this work, no public parallel data covered all of them, no benchmark spanned all 22 with India-relevant material, and no open or commercial model supported the full set. The authors address this on four fronts: training data… - MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks (2024 · 74 citations)
Most LLM evaluation targets English, so it is unclear how recent models handle other languages, especially low-resource ones. - Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation? (2023 · 69 citations)
Scaling LLM evaluation beyond English is difficult. Benchmarks cover few languages and few realistic tasks, automatic metrics handle rich morphology and unusual scripts poorly, and native-speaker judges are costly and slow. The authors test whether GPT-4, scoring outputs without reference texts, can replace or…
Co-authors here
- Kalika Bali ×2
- Mohamed Ahmed ×2
- Rishav Hada ×2
- Sunayana Sitaram ×2
- Harshita Diddee
- Jay Gala
- Millicent Ochieng
- Mitesh M. Khapra
- Monojit Choudhury
- Prachi Jain
- Pratyush Kumar
- Raghavan AK
Venues
- Conference of the North American Chapter of the Association for Computational Linguistics (NAACL): NAACL 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/varun-gumma/