Who cites Varun Gumma
- LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation MethodsarXiv:2412.05579Haitao Li, Qian Dong, Junjie Chen, et al.2024 · 189 citations
- The Prompt Report: A Systematic Survey of Prompt Engineering TechniquesarXiv:2406.06608Sander Schulhoff, Michael Ilie, Nishant Balepur, et al.2024 · 187 citations
- LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation TasksarXiv:2406.18403Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, et al.2024 · 137 citations
- MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 101 citationsLanguage Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource LanguagesProceedings of the AAAI Conference on Artificial IntelligenceZihao Li, Yucheng Shi, Zirui Liu, et al.2024 · 95 citationsWMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & DialectsFindings of the Association for Computational LinguisticsDaniel Deutsch, Eleftheria Briakou, Isaac Rayburn Caswell, et al.2025 · 80 citationsMEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, et al.2024 · 74 citations
- INCLUDE: Evaluating Multilingual Language Understanding with Regional KnowledgearXiv:2411.19799Angelika Romanou, Negar Foroutan, Anna Sotnikova, et al.2024 · 73 citationsIrokoBench: A New Benchmark for African Languages in the Age of Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)David Ifeoluwa Adelani, Jessica Ojo, Israel Abebe Azime, et al.2025 · 69 citations
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?arXiv:2309.07462Rishav Hada, Varun Gumma, Adrian de Wynter, et al.2023 · 69 citations
- Can Large Language Models Predict the Outcome of Judicial Decisions?arXiv:2501.09768Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Amani Al-Ghraibah2025 · 2 citationsCan Linguistically Related Languages Guide LLM Translation in Low-Resource Settings?Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT)Aishwarya Ramasethu, Rohin Garg, Niyathi Allu, et al.2026 · 1 citationRevisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL)Amir Hossein Yari, Kalmit Kulkarni, Ahmad Raza Khan, et al.2026 · 1 citationAssessing and Improving Punctuation Robustness in English-Marathi Machine TranslationWorkshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT)Kaustubh Shivshankar Shejole, Sourabh Deoghare, Pushpak Bhattacharyya2026
- Santham: A Curated Sanskrit–Tamil Dataset with Anvaya and Segmentation for Building and Evaluating Machine TranslationProceedings of the 8th International Sanskrit Computational Linguistics SymposiumPrasanna Venkatesh T S, Ketaki Mangesh Shetye, Vishnuraj Arjunasamy, et al.2026STAR-IL: A Dataset for Style-Aware Machine Translation of Product Reviews in Indian LanguagesLanguage Resources and Evaluation Conference (LREC)Ketaki Shetye, Dipti Misra Sharma, Parameswari Krishnamurthy2026
MADLAD-400: A Multilingual And Document-Level Large Audited DatasetConference on Neural Information Processing Systems (NeurIPS)Sneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 211 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/varun-gumma/cited-by/