📰 Works of Conference on Machine Translation (WMT)

100 works · the most cited first · ← Conference on Machine Translation (WMT)

1. Meteor Universal: Language Specific Translation Evaluation for Any Target LanguageMichael Denkowski, Alon Lavie2014 · 2,392 citations
2. chrF: character n-gram F-score for automatic MT evaluationMaja Popović2015 · 2,105 citations
3. KenLM: Faster and Smaller Language Model QueriesKenneth Heafield2011 · 1,759 citations
4. Findings of the 2014 Workshop on Statistical Machine TranslationOndřej Bojar, Christian Buck, Christian Federmann, et al.2014 · 923 citations
5. Findings of the 2019 Conference on Machine Translation (WMT19)Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, et al.2019 · 839 citations
6. chrF++: words helping character n-gramsMaja Popović2017 · 749 citations
7. Findings of the 2017 Conference on Machine Translation (WMT17)Ondřej Bojar, Rajen Chatterjee, Christian Federmann, et al.2017 · 685 citations
8. Facebook FAIR's WMT19 News Translation Task SubmissionNathan Ng, Kyra Yee, Alexei Baevski, et al.2019 · 543 citations
9. Meteor 1.3: Automatic Metric for Reliable Optimization and Evaluation of Machine Translation SystemsMichael Denkowski, Alon Lavie2011 · 541 citations
10. Experiments in Domain Adaptation for Statistical Machine TranslationPhilipp Koehn, Josh Schroeder2007 · 481 citations
11. Syntax Augmented Machine Translation via Chart ParsingAndreas Zollmann, Ashish Venugopal2006 · 474 citations
12. Findings of the 2015 Workshop on Statistical Machine TranslationOndřej Bojar, Rajen Chatterjee, Christian Federmann, et al.2015 · 461 citations
13. Findings of the 2013 Workshop on Statistical Machine TranslationOndřej Bojar, Christian Buck, Chris Callison-Burch, et al.2013 · 441 citations
14. COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared TaskRicardo Rei, José G. C. de Souza, Duarte Alves, et al.2022 · 433 citations
15. Manual and Automatic Evaluation of Machine Translation between European LanguagesPhilipp Koehn, Christof Monz2006 · 433 citations
16. Optimizing Chinese Word Segmentation for Machine Translation PerformancePi-Chuan Chang, Michel Galley, Christopher D. Manning2008 · 420 citations
17. Findings of the 2020 Conference on Machine Translation (WMT20)Loïc Barrault, Magdalena Biesialska, Ondřej Bojar, et al.2020 · 401 citations
18. Mixture-Model Adaptation for SMTGeorge Foster, Roland Kuhn2007 · 397 citations
19. METEOR: An Automatic Metric for MT Evaluation with High Levels of Correlation with Human JudgmentsAlon Lavie, Abhaya Agarwal2007 · 387 citations
20. CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared TaskRicardo Rei, Marcos Treviso, Nuno M. Guerreiro, et al.2022 · 325 citations
21. Tagged Back-TranslationIsaac Caswell, Ciprian Chelba, David Grangier2019 · 323 citations
22. Copied Monolingual Data Improves Low-Resource Neural Machine TranslationAnna Currey, Antonio Valerio Miceli Barone, Kenneth Heafield2017 · 296 citations
23. Results of the WMT19 Metrics Shared Task: Segment-Level and Strong MT Systems Pose Big ChallengesQingsong Ma, Johnny Wei, Ondřej Bojar, et al.2019 · 283 citations
24. A Systematic Comparison of Smoothing Techniques for Sentence-Level BLEUBoxing Chen, Colin Cherry2014 · 281 citations
25. Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More RobustMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.2022 · 263 citations
26. Domain Adaptation for Statistical Machine Translation with Monolingual ResourcesNicola Bertoldi, Marcello Federico2009 · 241 citations
27. The University of Edinburgh's Neural MT Systems for WMT17Rico Sennrich, Alexandra Birch, Anna Currey, et al.2017 · 227 citations
28. Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level Neural Machine TranslationMarcin Junczys-Dowmunt2019 · 222 citations
29. YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available ResourcesChi-kiu Lo2019 · 216 citations
30. Results of the WMT17 Metrics Shared TaskOndřej Bojar, Yvette Graham, Amir Kamran2017 · 210 citations
31. (Meta-) Evaluation of Machine TranslationChris Callison-Burch, Cameron Fordyce, Philipp Koehn, et al.2007 · 206 citations
32. Predictor-Estimator using Multilevel Task Learning with Stack Propagation for Neural Quality EstimationHyun Kim, Jong-Hyeok Lee, Seung-Hoon Na2017 · 205 citations
33. Findings of the 2012 Workshop on Statistical Machine TranslationChris Callison-Burch, Philipp Koehn, Christof Monz, et al.2012 · 203 citations
34. Results of the WMT20 Metrics Shared TaskNitika Mathur, Johnny Wei, Markus Freitag, et al.2020 · 195 citations
35. GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4Tom Kocmi, Christian Federmann2023 · 191 citations
36. Findings of the 2021 Conference on Machine Translation (WMT21)Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, et al.2021 · 189 citations
37. Improving Word Sense Disambiguation in Neural Machine Translation with Sense EmbeddingsAnnette Rios Gonzales, Laura Mascarell, Rico Sennrich2017 · 185 citations
38. The Tatoeba Translation Challenge – Realistic Data Sets for Low Resource and Multilingual MTJörg Tiedemann2020 · 183 citations
39. Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved YetTom Kocmi, Eleftherios Avramidis, Rachel Bawden, et al.2024 · 177 citations
40. Multi-Domain Neural Machine Translation through Unsupervised AdaptationM. Amin Farajian, Marco Turchi, Matteo Negri, et al.2017 · 176 citations
41. Results of the WMT14 Metrics Shared TaskMatouš Macháček, Ondřej Bojar2014 · 174 citations
42. Findings of the WMT 2019 Shared Tasks on Quality EstimationErick Fonseca, Lisa Yankovskaya, André F. T. Martins, et al.2019 · 173 citations
43. Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News DomainMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.2021 · 169 citations
44. Aiding Pronoun Translation with Co-Reference ResolutionRonan Le Nagard, Philipp Koehn2010 · 165 citations
45. Joshua: An Open Source Toolkit for Parsing-Based Machine TranslationZhifei Li, Chris Callison-Burch, Chris Dyer, et al.2009 · 163 citations
46. Findings of the WMT 2020 Shared Task on Quality EstimationLucia Specia, Frédéric Blain, Marina Fomicheva, et al.2020 · 160 citations
47. The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation EvaluationPatrick Fernandes, Daniel Deutsch, Mara Finkelstein, et al.2023 · 156 citations
48. Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors PersistMarzena Karpinska, Mohit Iyyer2023 · 156 citations
49. Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentMarkus Freitag, Nitika Mathur, Chi-kiu Lo, et al.2023 · 155 citations
50. Effective Domain Mixing for Neural Machine TranslationDenny Britz, Quoc Le, Reid Pryzant2017 · 155 citations
51. ChatGPT MT: Competitive for High- (but Not Low-) Resource LanguagesNathaniel Robinson, Perez Ogayo, David R. Mortensen, et al.2023 · 151 citations
52. The Effect of Translationese in Machine Translation Test SetsMike Zhang, Antonio Toral2019 · 149 citations
53. Findings of the 2009 Workshop on Statistical Machine TranslationChris Callison-Burch, Philipp Koehn, Christof Monz, et al.2009 · 136 citations
54. Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared TaskRicardo Rei, Nuno M. Guerreiro, José Pombal, et al.2023 · 135 citations
55. Findings of the 2011 Workshop on Statistical Machine TranslationChris Callison-Burch, Philipp Koehn, Christof Monz, et al.2011 · 135 citations
56. Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image DescriptionDesmond Elliott, Stella Frank, Loïc Barrault, et al.2017 · 133 citations
57. Quasi-Synchronous Grammars: Alignment by Soft Projection of Syntactic DependenciesDavid Smith, Jason Eisner2006 · 132 citations
58. Findings of the WMT 2019 Shared Task on Parallel Corpus Filtering for Low-Resource ConditionsPhilipp Koehn, Francisco Guzmán, Vishrav Chaudhary, et al.2019 · 131 citations
59. Findings of the WMT 2023 Shared Task on Quality EstimationFrederic Blain, Chrysoula Zerva, Ricardo Rei, et al.2023 · 129 citations
60. MetricX-24: The Google Submission to the WMT 2024 Metrics Shared TaskJuraj Juraska, Daniel Deutsch, Mara Finkelstein, et al.2024 · 118 citations
61. MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskJuraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.2023 · 118 citations
62. Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine TranslationChris Callison-Burch, Philipp Koehn, Christof Monz, et al.2010 · 117 citations
63. Fluency, Adequacy, or HTER? Exploring Different Human Judgments with a Tunable MT MetricMatthew Snover, Nitin Madnani, Bonnie Dorr, et al.2009 · 115 citations
64. Low-Resource Corpus Filtering Using Multilingual Sentence EmbeddingsVishrav Chaudhary, Yuqing Tang, Francisco Guzmán, et al.2019 · 110 citations
65. APE at Scale and Its Implications on MT Evaluation BiasesMarkus Freitag, Isaac Caswell, Scott Roy2019 · 107 citations
66. Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared TaskMarkus Freitag, Nitika Mathur, Daniel Deutsch, et al.2024 · 106 citations
67. Findings of the WMT 2019 Shared Task on Automatic Post-EditingRajen Chatterjee, Christian Federmann, Matteo Negri, et al.2019 · 102 citations
68. Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and AlignmentPhilipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, et al.2020 · 100 citations
69. Unbabel's Participation in the WMT20 Metrics Shared TaskRicardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 98 citations
70. The NiuTrans Machine Translation Systems for WMT19Bei Li, Yinqiao Li, Chen Xu, et al.2019 · 92 citations
71. Findings of the WMT 2022 Shared Task on Quality EstimationChrysoula Zerva, Frédéric Blain, Ricardo Rei, et al.2022 · 91 citations
72. Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared TaskRicardo Rei, Ana C Farinha, Chrysoula Zerva, et al.2021 · 85 citations
73. Error Span Annotation: A Balanced Approach for Human Evaluation of Machine TranslationTom Kocmi, Vilém Zouhar, Eleftherios Avramidis, et al.2024 · 83 citations
74. MEANT 2.0: Accurate semantic MT evaluation for any output languageChi-kiu Lo2017 · 81 citations
75. Findings of the WMT 2021 Shared Task on Quality EstimationLucia Specia, Frédéric Blain, Marina Fomicheva, et al.2021 · 80 citations
76. Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test SetsTom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, et al.2025 · 73 citations
77. Findings of the WMT 2017 Biomedical Translation Shared TaskAntonio Jimeno Yepes, Aurélie Névéol, Mariana Neves, et al.2017 · 69 citations
78. Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level MetricGiorgos Vernikos, Brian Thompson, Prashant Mathur, et al.2022 · 68 citations
79. A Fine-Grained Analysis of BERTScoreMichael Hanna, Ondřej Bojar2021 · 62 citations
80. Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared TaskThibault Sellam, Amy Pu, Hyung Won Chung, et al.2020 · 55 citations
81. Paraphrase Generation as Zero-Shot Multilingual Translation: Disentangling Semantic Similarity from Lexical and Syntactic DiversityBrian Thompson, Matt Post2020 · 55 citations
82. Findings of the WMT 2019 Biomedical Translation Shared Task: Evaluation for MEDLINE Abstracts and Biomedical TerminologiesRachel Bawden, Kevin Bretonnel Cohen, Cristian Grozea, et al.2019 · 54 citations
83. Morpho-syntactic Information for Automatic Error Analysis of Statistical Machine Translation OutputMaja Popović, Adrià de Gispert, Deepa Gupta, et al.2006 · 49 citations
84. Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form TextsEleftheria Briakou, Jiaming Luo, Colin Cherry, et al.2024 · 46 citations
85. Facebook AI's WMT21 News Translation Task SubmissionChau Tran, Shruti Bhosale, James Cross, et al.2021 · 42 citations
86. Findings of the WMT 2023 Shared Task on Low-Resource Indic Language TranslationSantanu Pal, Partha Pakray, Sahinur Rahman Laskar, et al.2023 · 41 citations
87. Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)Mathias Müller, Malihe Alikhani, Eleftherios Avramidis, et al.2023 · 39 citations
88. Towards Effective Disambiguation for Machine Translation with Large Language ModelsVivek Iyer, Pinzhen Chen, Alexandra Birch2023 · 38 citations
89. Linguistic Evaluation of German-English Machine Translation Using a Test SuiteEleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, et al.2019 · 38 citations
90. Phrase-Based and Deep Syntactic English-to-Czech Statistical Machine TranslationOndřej Bojar, Jan Hajič2008 · 37 citations
91. MaTESe: Machine Translation Evaluation as a Sequence Tagging ProblemStefano Perrella, Lorenzo Proietti, Alessandro Scirè, et al.2022 · 32 citations
92. ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation MetricsChantal Amrhein, Nikita Moghe, Liane Guillou2022 · 29 citations
93. Findings of the WMT 2020 Shared Task on Chat TranslationM. Amin Farajian, António V. Lopes, André F. T. Martins, et al.2020 · 29 citations
94. Formemes in English-Czech Deep Syntactic MTOndřej Dušek, Zdeněk Žabokrtský, Martin Popel, et al.2012 · 28 citations
95. Findings of WMT 2024 Shared Task on Low-Resource Indic Languages TranslationPartha Pakray, Santanu Pal, Advaitha Vetagiri, et al.2024 · 21 citations
96. Anaphora Models and Reordering for Phrase-Based SMTChristian Hardmeier, Sara Stymne, Jörg Tiedemann, et al.2014 · 13 citations
97. Incorporate Semantic Structures into Machine Translation Evaluation via UCCAJin Xu, Yinuo Guo, Junfeng Hu2020 · 12 citations
98. Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language DirectionsVivien Macketanz, Shushen Manakhimova, Eleftherios Avramidis, et al.2022 · 8 citations
99. Apertium-fin-eng–Rule-based Shallow Machine Translation for WMT 2019 Shared TaskTommi A Pirinen2019 · 6 citations
100. Ranking Translations using Error Analysis and Quality EstimationMark Fishel2013 · 2 citations

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/wmt/works/