📰 WMT 2023: all accepted papers

100 papers · the most cited first · ← WMT 2023

1. Findings of the WMT 2023 Shared Task on Quality EstimationFrederic Blain, Chrysoula Zerva, Ricardo Rei et al.73 citations · our summary
2. Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors PersistMarzena Karpinska, Mohit Iyyer65 citations · our summary
3. ChatGPT MT: Competitive for High- (but Not Low-) Resource LanguagesNathaniel Robinson, Perez Ogayo, David R. Mortensen et al.51 citations · our summary
4. Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA ↗Xuan Zhang, Navid Rajabi, Kevin Duh et al.42 citations
5. Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet ↗Tom Kocmi, Eleftherios Avramidis, Rachel Bawden et al.38 citations
6. GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4Tom Kocmi, Christian Federmann36 citations · our summary
7. The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation EvaluationPatrick Fernandes, Daniel Deutsch, Mara Finkelstein et al.33 citations · our summary
8. Exploring Prompt Engineering with GPT Language Models for Document-Level Machine Translation: Insights and Findings ↗Yangjian Wu, Gang Hu28 citations
9. Domain Terminology Integration into Machine Translation: Leveraging Large Language Models ↗Yasmin Moslem, Gianfranco Romani, Mahdi Molaei et al.25 citations
10. Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? ↗Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz et al.20 citations
11. Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared TaskRicardo Rei, Nuno M. Guerreiro, José Pombal et al.20 citations · our summary
12. Findings of the WMT 2023 Shared Task on Automatic Post-Editing ↗Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag et al.17 citations
13. Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentMarkus Freitag, Nitika Mathur, Chi-kiu Lo et al.17 citations · our summary
14. Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)Mathias Müller, Malihe Alikhani, Eleftherios Avramidis et al.16 citations · our summary
15. Towards Effective Disambiguation for Machine Translation with Large Language ModelsVivek Iyer, Pinzhen Chen, Alexandra Birch13 citations · our summary
16. Findings of the WMT 2023 Shared Task on Low-Resource Indic Language TranslationSantanu Pal, Partha Pakray, Sahinur Rahman Laskar et al.11 citations · our summary
17. HW-TSC's Participation in the WMT 2023 Automatic Post Editing Shared Task ↗Jiawei Yu, Min Zhang, Zhao Yanqing et al.11 citations
18. One Wide Feedforward Is All You Need ↗Telmo Pires, António Vilarinho Lopes, Yannick Assogba et al.11 citations
19. MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskJuraj Juraska, Mara Finkelstein, Daniel Deutsch et al.8 citations · our summary
20. Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics ↗Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt7 citations
21. Findings of the Word-Level AutoCompletion Shared Task in WMT 2023 ↗Lemao Liu, Francisco Casacuberta, George Foster et al.7 citations
22. Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting ↗Nikolay Bogoychev, Pinzhen Chen7 citations
23. Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level ↗Daniel Deutsch, Juraj Juraska, Mara Finkelstein et al.7 citations
24. Embed_Llama: Using LLM Embeddings for the Metrics Shared Task ↗Sören Dreano, Derek Molloy, Noel Murphy6 citations
25. Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs ↗Longyue Wang, Zhaopeng Tu, Yan Gu et al.6 citations
26. GUIT-NLP's Submission to Shared Task: Low Resource Indic Language Translation ↗Mazida Akhtara Ahmed, Kuwali Talukdar, Parvez Aziz Boruah et al.6 citations
27. Empowering a Metric with LLM-assisted Named Entity Annotation: HW-TSC's Submission to the WMT23 Metrics Shared Task ↗Zhanglin Wu, Yilun Liu, Min Zhang et al.5 citations
28. MEE4 and XLsim : IIIT HYD's Submissions' for WMT23 Metrics Shared Task ↗Ananya Mukherjee, Manish Shrivastava5 citations
29. Quality Estimation Using Minimum Bayes Risk ↗Subhajit Naskar, Daniel Deutsch, Markus Freitag5 citations
30. AIST AIRC Submissions to the WMT23 Shared Task ↗Matiss Rikters, Makoto Miwa4 citations
31. Achieving State-of-the-Art Multilingual Translation Model with Minimal Data and Parameters ↗Hui Zeng4 citations
32. Document-Level Language Models for Machine Translation ↗Frithjof Petrick, Christian Herold, Pavel Petrushkov et al.4 citations
33. Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies ↗Kirill Semenov, Vilém Zouhar, Tom Kocmi et al.4 citations
34. KYB General Machine Translation Systems for WMT23 ↗Ben Li, Yoko Matsuzaki, Shivam Kalkar4 citations
35. Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality ↗Chi-kiu Lo, Samuel Larkin, Rebecca Knowles4 citations
36. Neural Machine Translation for English - Manipuri and English - Assamese ↗Goutam Agrawal, Rituraj Das, Anupam Biswas et al.4 citations
37. PRHLT's Submission to WLAC 2023 ↗Angel Navarro, Miguel Domingo, Francisco Casacuberta4 citations
38. PROMT Systems for WMT23 Shared General Translation Task ↗Alexander Molchanov, Vladislav Kovalenko4 citations
39. Treating General MT Shared Task as a Multi-Domain Adaptation Problem: HW-TSC's Submission to the WMT23 General MT Shared Task ↗Zhanglin Wu, Daimeng Wei, Zongyao Li et al.4 citations
40. eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings ↗Muhammad ElNokrashy, Tom Kocmi4 citations
41. ACES: Translation Accuracy Challenge Sets at WMT 2023 ↗Chantal Amrhein, Nikita Moghe, Liane Guillou3 citations
42. Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective ↗Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz et al.3 citations
43. Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System ↗Mariana Neves, Antonio Jimeno Yepes, Aurélie Névéol et al.3 citations
44. HW-TSC 2023 Submission for the Quality Estimation Shared Task ↗Yuang Li, Chang Su, Ming Zhu et al.3 citations
45. IACS-LRILT: Machine Translation for Low-Resource Indic Languages ↗Dhairya Suman, Atanu Mandal, Santanu Pal et al.3 citations
46. Identifying Context-Dependent Translations for Evaluation Set Production ↗Rachel Wicks, Matt Post3 citations
47. KnowComp Submission for WMT23 Sign Language Translation Task ↗Baixuan Xu, Haochen Shi, Tianshi Zheng et al.3 citations
48. MUNI-NLP Systems for Low-resource Indic Machine Translation ↗Edoardo Signoroni, Pavel Rychly3 citations
49. Machine Translation Advancements for Low-Resource Indian Languages in WMT23: CFILT-IITB's Effort for Bridging the Gap ↗Meet Doshi, Pranav Gaikwad, Sourabh Deoghare et al.3 citations
50. NAIST-NICT WMT'23 General MT Task Submission ↗Hiroyuki Deguchi, Kenji Imamura, Yuto Nishida et al.3 citations
51. RoCS-MT: Robustness Challenge Set for Machine Translation ↗Rachel Bawden, Benoît Sagot3 citations
52. SKIM at WMT 2023 General Translation Task ↗Keito Kudo, Takumi Ito, Makoto Morishita et al.3 citations
53. Semantically-Informed Regressive Encoder Score ↗Vasiliy Viskov, George Kokush, Daniil Larionov et al.3 citations
54. Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INES ↗Beatrice Savoldi, Marco Gaido, Matteo Negri et al.3 citations
55. UvA-MT's Participation in the WMT 2023 General Translation Shared Task ↗Di Wu, Shaomu Tan, David Stap et al.3 citations
56. Yishu: Yishu at WMT2023 Translation Task ↗Luo Min, Yixin Tan, Qiulin Chen3 citations
57. DUTNLP System for the WMT2023 Discourse-Level Literary Translation ↗Anqi Zhao, Kaiyu Huang, Hao Yu et al.2 citations
58. Evaluating Metrics for Document-context Evaluation in Machine Translation ↗Vikas Raunak, Tom Kocmi, Matt Post2 citations
59. Findings of the WMT 2023 Shared Task on Parallel Data Curation ↗Steve Sloto, Brian Thompson, Huda Khayrallah et al.2 citations
60. IOL Research Machine Translation Systems for WMT23 General Machine Translation Shared Task ↗Wenbo Zhang2 citations
61. IOL Research's Submission for WMT 2023 Quality Estimation Shared Task ↗Zeyu Yan2 citations
62. Low-Resource Machine Translation Systems for Indic Languages ↗Ivana Kvapilíková, Ondřej Bojar2 citations
63. MUNI-NLP Submission for Czech-Ukrainian Translation Task at WMT23 ↗Pavel Rychly, Yuliia Teslia2 citations
64. Multifaceted Challenge Set for Evaluating Machine Translation Performance ↗Xiaoyu Chen, Daimeng Wei, Zhanglin Wu et al.2 citations
65. NITS-CNLP Low-Resource Neural Machine Translation Systems of English-Manipuri Language Pair ↗Kshetrimayum Boynao Singh, Ningthoujam Avichandra Singh, Loitongbam Sanayai Meetei et al.2 citations
66. SJTU-MTLAB's Submission to the WMT23 Word-Level Auto Completion Task ↗Xingyu Chen, Rui Wang2 citations
67. TTIC's Submission to WMT-SLT 23 ↗Marcelo Sandoval-Castaneda, Yanhong Li, Bowen Shi et al.2 citations
68. There's No Data like Better Data: Using QE Metrics for MT Data Filtering ↗Jan-Thorsten Peter, David Vilar, Daniel Deutsch et al.2 citations
69. Tokengram_F, a Fast and Accurate Token-based chrF++ Derivative ↗Sören Dreano, Derek Molloy, Noel Murphy2 citations
70. Towards Better Evaluation for Formality-Controlled English-Japanese Machine Translation ↗Edison Marrese-Taylor, Pin Chen Wang, Yutaka Matsuo2 citations
71. Unify Word-level and Span-level Tasks: NJUNLP's Participation for the WMT2023 Quality Estimation Shared Task ↗Xiang Geng, Zhejian Lai, Yu Zhang et al.2 citations
72. A Benchmark for Evaluating Machine Translation Metrics on Dialects without Standard Orthography ↗Noëmi Aepli, Chantal Amrhein, Florian Schottmann et al.1 citation
73. A Fast Method to Filter Noisy Parallel Data WMT2023 Shared Task on Parallel Data Curation ↗Nguyen-Hoang Minh-Cong, Nguyen Van Vinh, Nguyen Le-Minh1 citation
74. A Sentence Alignment Approach to Document Alignment and Multi-faceted Filtering for Curating Parallel Sentence Pairs from Web-crawled Data ↗Steinthor Steingrimsson1 citation
75. Automating Behavioral Testing in Machine Translation ↗Javier Ferrando, Matthias Sperber, Hendra Setiawan et al.1 citation
76. Biomedical Parallel Sentence Retrieval Using Large Language Models ↗Sheema Firdous, Sadaf Abdul Rauf1 citation
77. Bridging the Gap between Position-Based and Content-Based Self-Attention for Neural Machine Translation ↗Felix Schmidt, Mattia Di Gangi1 citation
78. CUNI at WMT23 General Translation Task: MT and a Genetic Algorithm ↗Josef Jon, Martin Popel, Ondřej Bojar1 citation
79. GTCOM and DLUT's Neural Machine Translation Systems for WMT23 ↗Hao Zong1 citation
80. HW-TSC's Submissions to the WMT23 Discourse-Level Literary Translation Shared Task ↗Yuhao Xie, Zongyao Li, Zhanglin Wu et al.1 citation
81. IIIT HYD's Submission for WMT23 Test-suite Task ↗Ananya Mukherjee, Manish Shrivastava1 citation
82. IOL Research Machine Translation Systems for WMT23 Low-Resource Indic Language Translation Shared Task ↗Wenbo Zhang1 citation
83. KnowComp Submission for WMT23 Word-Level AutoCompletion Task ↗Yi Wu, Haochen Shi, Weiqi Wang et al.1 citation
84. Lingua Custodia's Participation at the WMT 2023 Terminology Shared Task ↗Jingshu Liu, Mariam Nakhlé, Gaëtan Caillout et al.1 citation
85. MMT's Submission for the WMT 2023 Quality Estimation Shared Task ↗Yulong Wu, Viktor Schlegel, Daniel Beck et al.1 citation
86. NICT-AI4B's Submission to the Indic MT Shared Task in WMT 2023 ↗Raj Dabre, Jay Gala, Pranjal A. Chitale1 citation
87. OPUS-CAT Terminology Systems for the WMT23 Terminology Shared Task ↗Tommi Nieminen1 citation
88. Samsung R&D Institute Philippines at WMT 2023 ↗Jan Christian Blaise Cruz1 citation
89. SurreyAI 2023 Submission for the Quality Estimation Shared Task ↗Archchana Sindhujan, Diptesh Kanojia, Constantin Orasan et al.1 citation
90. TJUNLP:System Description for the WMT23 Literary Task in Chinese to English Translation Direction ↗Shaolin Zhu, Deyi Xiong1 citation
91. The Path to Continuous Domain Adaptation Improvements by HW-TSC for the WMT23 Biomedical Translation Shared Task ↗Zhanglin Wu, Daimeng Wei, Zongyao Li et al.1 citation
92. Trained MT Metrics Learn to Cope with Machine-translated References ↗Jannis Vamvas, Tobias Domhan, Sony Trenous et al.1 citation
93. VARCO-MT: NCSOFT's WMT'23 Terminology Shared Task Submission ↗Geon Woo Park, Junghwa Lee, Meiying Ren et al.1 citation
94. A Closer Look at Transformer Attention for Multilingual Translation ↗Jingyi Zhang, Gerard de Melo, Hongfei Xu et al.
95. Investigating Techniques for a Deeper Understanding of Neural Machine Translation (NMT) Systems through Data Filtering and Fine-tuning Strategies ↗Lichao Zhu, Maria Zimina, Maud Bénard et al.
96. MAX-ISI System at WMT23 Discourse-Level Literary Translation Task ↗Li An, Linghao Jin, Xuezhe Ma
97. Machine Translation for Nko: Tools, Corpora, and Baseline Results ↗Moussa Doumbouya, Baba Mamadi Diané, Solo Farabado Cissé et al.
98. The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages ↗Benjamin Muller, Belen Alastruey, Prangthip Hansanti et al.
99. The MAKE-NMTVIZ System Description for the WMT23 Literary Task ↗Fabien Lopez, Gabriela González, Damien Hansen et al.
100. Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation ↗Tosho Hirasawa, Emanuele Bugliarello, Desmond Elliott et al.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/wmt/2023/papers/