Vraj Shah
Vraj Shah has 2 papers in our library, in 2026, most of them on Evaluation & benchmarks; often with Marina Danilevsky, Sara Rosenthal, Yannis Katsis.
OpenAlex · h-index 1 · 5 works · 1 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 53 times in our library · ⭐ Paper Stars ranking: #7732
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksInformation Systems · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Evaluation & benchmarks · 1 work
Works by year
2020s
Papers
- MTRAG-UN: A Benchmark for Open Challenges in Multi-Turn RAG Conversations (2026 · 27 citations)
MTRAG-UN is a new benchmark from IBM Research. It targets cases in multi-turn retrieval-augmented generation (RAG) where a single question-answer exchange is not enough for the user. It extends the earlier MTRAG benchmark with four stress cases: - SemEval-2026 Task 8: MTRAGEval: Evaluating Multi-Turn RAG Conversations (2026 · 26 citations)
This shared task evaluates retrieval-augmented generation in multi-turn dialogue. In that setting, follow-up questions often depend on earlier turns, cannot be answered from the corpus, or are ambiguous. The organizers split the pipeline into three subtasks: retrieval only (A), answer generation from gold passages…
Co-authors here
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
- International Workshop on Semantic Evaluation (SemEval): SemEval 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/vraj-shah/