🧑‍🔬 Eleftherios Avramidis — all works

38 works · ← Eleftherios Avramidis

1. Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More RobustMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.Machine translation · 265 citations
2. Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved YetConference on Machine Translation (WMT)Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, et al.2024 · 178 citations
3. Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.2023 · 155 citations
4. Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared TaskConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Daniel Deutsch, et al.2024 · 107 citations
5. Error Span Annotation: A Balanced Approach for Human Evaluation of Machine TranslationConference on Machine Translation (WMT)Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, et al.2024 · 83 citations
6. Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test SetsConference on Machine Translation (WMT)Tom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, et al.2025 · 73 citations
7. Using a new analytic measure for the annotation and analysis of MT errors on real data ↗Proceedings of the 17th Annual Conference of the European Association for Machine Translation · no summary yetArle Lommel et al.2014 · 62 citations
8. Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features ↗Proceedings of the Sixth Workshop on Statistical Machine Translation · no summary yetEleftherios Avramidis et al.2011 · 48 citations
9. Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? ↗Proceedings of the Eighth Conference on Machine Translation · no summary yetShushen Manakhimova et al.2023 · 43 citations
10. Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help ↗Proceedings of the Tenth Conference on Machine Translation · no summary yetAlon Lavie et al.2025 · 39 citations
11. Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)Conference on Machine Translation (WMT)Mathias Müller, Malihe Alikhani, Eleftherios Avramidis, et al.2023 · 39 citations
12. Linguistic Evaluation of German-English Machine Translation Using a Test SuiteConference on Machine Translation (WMT)Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, et al.2019 · 38 citations
13. Quality estimation for Machine Translation output using linguistic analysis and decoding features ↗Proceedings of the Seventh Workshop on Statistical Machine Translation · no summary yetAvramidis, Eleftherios2012 · 36 citations
14. Fine-grained evaluation of German-English Machine Translation based on a Test Suite ↗Proceedings of the Third Conference on Machine Translation: Shared Task Papers · no summary yetVivien Macketanz et al.2018 · 33 citations
15. Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically motivated Test Suite ↗Proceedings of the AMTA 2018 Workshop on Translation Quality Estimation and Automatic Post-Editing · no summary yetEleftherios Avramidis et al.2018 · 23 citations
16. Comparative Quality Estimation: Automatic Sentence-Level Ranking of Multiple Machine Translation Outputs ↗Proceedings of COLING 2012 · no summary yetAvramidis, Eleftherios2012 · 21 citations
17. A Linguistically Motivated Test Suite to Semi-Automatically Evaluate German–English Machine Translation Output ↗Proceedings of the Thirteenth Language Resources and Evaluation Conference · no summary yetVivien Macketanz et al.2022 · 19 citations
18. Fine-grained linguistic evaluation for state-of-the-art Machine Translation ↗Proceedings of the Fifth Conference on Machine Translation · no summary yetEleftherios Avramidis et al.2020 · 18 citations
19. Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set ↗Proceedings of the Seventh Conference on Machine Translation (WMT) · no summary yetEleftherios Avramidis, Vivien Macketanz2022 · 14 citations
20. Learning from Human Judgments of Machine Translation Output ↗Proceedings of Machine Translation Summit XIV: Posters · no summary yetMaja Popovic et al.2013 · 13 citations
21. Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective ↗Proceedings of the Eighth Conference on Machine Translation · no summary yetEleftherios Avramidis et al.2023 · 12 citations
22. Efforts on Machine Learning over Human-mediated Translation Edit Rate ↗Proceedings of the Ninth Workshop on Statistical Machine Translation · no summary yetAvramidis, Eleftherios2014 · 9 citations
23. Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language DirectionsVivien Macketanz, Shushen Manakhimova, Eleftherios Avramidis, et al.Machine translation · 8 citations
24. Deeper Machine Translation and Evaluation for German ↗Proceedings of the 2nd Deep Machine Translation Workshop · no summary yetEleftherios Avramidis et al.2016 · 8 citations
25. Involving Language Professionals in the Evaluation of Machine Translation ↗Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) · no summary yetEleftherios Avramidis et al.2012 · 7 citations
26. Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation ↗Proceedings of the Ninth Conference on Machine Translation · no summary yetEleftherios Avramidis et al.2024 · 6 citations
27. A Richly Annotated, Multilingual Parallel Corpus for Hybrid Machine Translation ↗Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) · no summary yetEleftherios Avramidis et al.2012 · 5 citations
28. Machine Translation Metrics Are Better in Evaluating Linguistic Errors on LLMs than on Encoder-Decoder Systems ↗Proceedings of the Ninth Conference on Machine Translation · no summary yetEleftherios Avramidis et al.2024 · 4 citations
29. Selecting Feature Sets for Comparative and Time-Oriented Quality Estimation of Machine Translation Output ↗Proceedings of the Eighth Workshop on Statistical Machine Translation · no summary yetEleftherios Avramidis, Maja Popović2013 · 4 citations
30. DGS-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between German Sign Language and German Text ↗Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) · no summary yetFabrizio Nunnari et al.2024 · 3 citations
31. Sentence-level quality estimation by predicting HTER as a multi-component metric ↗Proceedings of the Second Conference on Machine Translation · no summary yetAvramidis, Eleftherios2017 · 3 citations
32. The ML4HMT Workshop on Optimising the Division of Labour in Hybrid Machine Translation ↗Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) · no summary yetChristian Federmann et al.2012 · 3 citations
33. A Critical Study of Automatic Evaluation in Sign Language TranslationLanguage Resources and Evaluation Conference (LREC)Shakib Yazdani, Yasser HAMIDULLAH, Cristina España-Bonet, et al.2026 · 2 citations
34. Fine-Grained Evaluation of English-Russian MT in 2025: Linguistic Challenges Mirroring Human Translator Training ↗Proceedings of the Tenth Conference on Machine Translation · no summary yetShushen Manakhimova et al.2025 · 2 citations
35. A Comprehensive Evaluation of Chain-of-Thought Faithfulness in Persian Classification TasksWorkshop on Language Models for Low-Resource LanguagesShakib Yazdani, Cristina España-Bonet, Eleftherios Avramidis, et al.2026 · 1 citation
36. Correlating decoding events with errors in Statistical Machine Translation ↗Proceedings of the 11th International Conference on Natural Language Processing · no summary yetEleftherios Avramidis, Maja Popović2014 · 1 citation
37. Towards Deeper MT - A Hybrid System for German ↗Proceedings of the 1st Deep Machine Translation Workshop · no summary yetEleftherios Avramidis et al.2015
38. A CCG-based Quality Estimation Metric for Statistical Machine Translation Learning from Human Judgments of Machine Translation Output ↗Proceedings of Machine Translation Summit XIV: Posters · no summary yetMaja Popovic et al.2013

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/eleftherios-avramidis/works/