Elamur Research⌕
☰
home / authors / Ekaterina Artemova

Ekaterina Artemova

Ekaterina Artemova has 3 papers in our library, in 2024–2026, most of them on Evaluation & benchmarks, Machine translation, Language models & pretraining; often with Sergei Tilga, Abdelrahman Mohamed, Ali Mekky.

3 papers in our library · 2024–2026

OpenAlex · ORCID · Wikidata · h-index 14 · 86 works · 841 citations OpenAlex, 2026-10-14

📄 3 works in our library · 🔗 Cited 114 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #7983

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓Technische Universität DarmstadtDarmstadt · Germany2026 · 3 paperscurrent🎓National Research University Higher School of EconomicsMoscow · Russia2014–2024 · 36 papers🎓Ludwig-Maximilians-Universität MünchenMunich · Germany2022–2023 · 7 papers🏢Huawei TechnologiesShenzhen · China2021–2022 · 5 papers🎓Munich Center for Machine LearningMunich · Germany2023–2024 · 3 papers🎓University of OsloOslo · Norway2024 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 worksComputational Theory and Mathematics · 1 work

🧭 Topics 6Research subjects and languages the work is about.Evaluation & benchmarks · 2 worksMachine translation · 1 workSemitic languages · 1 workVision & language · 1 workLanguage models & pretraining · 1 workReasoning · 1 work

 Works by year

2020s

20261 paper20251 paper20241 paper

 Papers

The most cited first (OpenAlex and our library).

  1. Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets (2025 · 73 citations)
    The WMT25 General Machine Translation shared task asks how well current MT systems, now mostly LLM-based, handle demanding, realistic input.
  2. U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMs (2024 · 13 citations)
    Most math benchmarks for LLMs target school-level or Olympiad problems, use multiple-choice formats, are small, or draw on public material that may have leaked into training data.
  3. JEEM: Vision-Language Understanding in Four Arabic Dialects (2026 · 11 citations)
    JEEM addresses a gap in evaluating vision-language models (VLMs) for Arabic. Existing Arabic multimodal data mostly comes from translated or relabeled Western images, and it is written in MSA or covers only one dialect. The authors built a benchmark with images from Jordan, the Emirates, Egypt and Morocco, one…

All works

5 works of theirs in our library, the most cited first; 3 with a page here, the others link their original until we summarise them.

  1. Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test SetsConference on Machine Translation (WMT)Tom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, et al.2025 · 73 citations
  2. U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMsarXiv:2412.03205Konstantin Chernyshev, Vitaliy Polshkov, Ekaterina Artemova, et al.2024 · 13 citations
  3. JEEM: Vision-Language Understanding in Four Arabic DialectsFindings of the Association for Computational LinguisticsKarima Kadaoui, Hanin Atwany, Hamdan Al-Ali, et al.2026 · 11 citations
  4. Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Data ↗Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) · no summary yetSiyao Peng et al.2024 · 11 citations
  5. Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varieties ↗Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetEkaterina Artemova, Verena Blaschke, Barbara Plank2024 · 7 citations

 Co-authors here

12 of 17 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 114 times (of the 149,439 papers whose bibliographies we read); 39 citing papers with a page here →.

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/ekaterina-artemova/