🧑‍🔬 Daniel Deutsch — all works

34 works · ← Daniel Deutsch

1. Gemma 3 Technical Report ↗arXiv:2503.19786 · no summary yetGemma Team et al.2025 · 1,147 citations
2. The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation EvaluationConference on Machine Translation (WMT)Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, et al.2023 · 158 citations
3. Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.2023 · 155 citations
4. Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a SummaryTransactions of the Association for Computational Linguistics (TACL)Daniel Deutsch, Tania Bedrax-Weiss, Dan Roth2021 · 152 citations
5. MetricX-24: The Google Submission to the WMT 2024 Metrics Shared TaskConference on Machine Translation (WMT)Juraj Juraska, Daniel Deutsch, Mara Finkelstein, et al.2024 · 118 citations
6. MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskConference on Machine Translation (WMT)Juraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.2023 · 118 citations
7. A Statistical Analysis of Summarization Evaluation Metrics Using Resampling MethodsTransactions of the Association for Computational Linguistics (TACL)Daniel Deutsch, Rotem Dror, Dan Roth2021 · 117 citations
8. Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared TaskConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Daniel Deutsch, et al.2024 · 107 citations
9. WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & DialectsFindings of the Association for Computational LinguisticsDaniel Deutsch, Eleftheria Briakou, Isaac Rayburn Caswell, et al.2025 · 80 citations
10. Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie CalibrationConference on Empirical Methods in Natural Language Processing (EMNLP)Daniel Deutsch, George Foster, Markus Freitag2023 · 76 citations
11. On the Limitations of Reference-Free Evaluations of Generated Text ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetDaniel Deutsch, Rotem Dror, Dan Roth2022 · 69 citations
12. Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetDaniel Deutsch, Rotem Dror, Dan Roth2022 · 54 citations
13. Understanding the Extent to which Content Quality Metrics Measure the Information Quality of Summaries ↗Proceedings of the 25th Conference on Computational Natural Language Learning · no summary yetDaniel Deutsch, Dan Roth2021 · 47 citations
14. Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help ↗Proceedings of the Tenth Conference on Machine Translation · no summary yetAlon Lavie et al.2025 · 39 citations
15. SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics ↗Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS) · no summary yetDaniel Deutsch, Dan Roth2020 · 35 citations
16. A General-Purpose Algorithm for Constrained Sequential Inference ↗Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL) · no summary yetDaniel Deutsch, Shyam Upadhyay, Dan Roth2019 · 30 citations
17. Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level ↗Proceedings of the Eighth Conference on Machine Translation · no summary yetDaniel Deutsch et al.2023 · 25 citations
18. There's No Data like Better Data: Using QE Metrics for MT Data Filtering ↗Proceedings of the Eighth Conference on Machine Translation · no summary yetJan-Thorsten Peter et al.2023 · 21 citations
19. A Distributional and Orthographic Aggregation Model for English Derivational MorphologyDaniel Deutsch, John Hewitt, Dan RothEnglish · 19 citations
20. Quality Estimation Using Minimum Bayes Risk ↗Proceedings of the Eighth Conference on Machine Translation · no summary yetSubhajit Naskar, Daniel Deutsch, Markus Freitag2023 · 14 citations
21. SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?Conference on Empirical Methods in Natural Language Processing (EMNLP)Senyu Li, Jiayi Wang, Felermino D. M. A. Ali, et al.2025 · 13 citations
22. Summary Cloze: A New Task for Content Selection in Topic-Focused Summarization ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetDaniel Deutsch, Dan Roth2019 · 12 citations
23. MetricX-25 and GemSpanEval: Google Translate Submissions to the WMT25 Evaluation Shared Task ↗Proceedings of the Tenth Conference on Machine Translation · no summary yetJuraj Juraska et al.2025 · 11 citations
24. Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries ↗arXiv (Cornell University) · no summary yetDaniel Deutsch, Dan Roth2020 · 11 citations
25. Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection ↗Proceedings of the 28th International Conference on Computational Linguistics · no summary yetDisha Jindal, Daniel Deutsch, Dan Roth2020 · 11 citations
26. Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data ↗Proceedings of the Ninth Conference on Machine Translation · no summary yetZhongtao Liu et al.2024 · 10 citations
27. Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection ↗Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · no summary yetDaniel Deutsch, Dan Roth2023 · 10 citations
28. Enhancing Human Evaluation in Machine Translation with Comparative Judgement ↗Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetYixiao Song et al.2025 · 7 citations
29. Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation ↗arXiv:2501.18771 · no summary yetMuhammed Yusuf Kocyigit et al.2025 · 5 citations
30. Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ↗Findings of the Association for Computational Linguistics: ACL 2022 · no summary yetDaniel Deutsch, Dan Roth2022 · 5 citations
31. Enhancing Human Evaluation in Machine Translation with Comparative Judgment ↗arXiv:2502.17797 · no summary yetYixiao Song et al.2025 · 4 citations
32. Generating Difficult-to-Translate TextsWorkshop on Multilingual Multicultural EvaluationVilém Zouhar, Wenda Xu, Parker Riley, et al.2026 · 3 citations
33. Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code ↗arXiv (Cornell University) · no summary yetDaniel Deutsch, Dan Roth2022 · 3 citations
34. MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Parker Riley, Daniel Deutsch, Mara Finkelstein, et al.2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/daniel-deutsch/works/