Elamur Research⌕
☰
home / papers / COMET: A Neural Framework for MT Evaluation / cited by

Who cites «COMET: A Neural Framework for MT Evaluation»

1,167 papers of our library cite it (of the 141,840 whose bibliographies we read) · 128 with a page here, the most cited first · page 1 of 2 · 1–100 · ← the paper

1 2

  1. BARTScore: Evaluating Generated Text as Text GenerationWeizhe Yuan, Graham Neubig, Pengfei Liu2021 · 807 citations
  2. Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationMarkus Freitag, George Foster, David Grangier, et al.2021 · 660 citations
  3. Multilingual Machine Translation with Large Language Models: Empirical Results and AnalysisWenhao Zhu, Hongyi Liu, Qingxiu Dong, et al.2024 · 503 citations
  4. COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared TaskRicardo Rei, José G. C. de Souza, Duarte Alves, et al.2022 · 433 citations
  5. CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared TaskRicardo Rei, Marcos Treviso, Nuno M. Guerreiro, et al.2022 · 325 citations
  6. Document-Level Machine Translation with Large Language ModelsLongyue Wang, Chenyang Lyu, Tianbo Ji, et al.2023 · 296 citations
  7. Prompting Large Language Model for Machine Translation: A Case StudyBiao Zhang, Barry Haddow, Alexandra Birch2023 · 293 citations
  8. Is ChatGPT a Good NLG Evaluator? A Preliminary StudyJiaan Wang, Yunlong Liang, Fandong Meng, et al.2023 · 282 citations
  9. Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More RobustMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.2022 · 263 citations
  10. In-context Examples Selection for Machine TranslationSweta Agrawal, Chunting Zhou, Mike Lewis, et al.2023 · 242 citations
  11. Reinforced Self-Training (ReST) for Language ModelingCaglar Gulcehre, Tom Le Paine, Srivatsan Srinivasan, et al.2023 · 209 citations
  12. IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesJay Gala, Pranjal A. Chitale, Raghavan AK, et al.2023 · 200 citations
  13. Results of the WMT20 Metrics Shared TaskNitika Mathur, Johnny Wei, Markus Freitag, et al.2020 · 195 citations
  14. GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4Tom Kocmi, Christian Federmann2023 · 191 citations
  15. Towards Making the Most of ChatGPT for Machine TranslationKeqin Peng, Liang Ding, Qihuang Zhong, et al.2023 · 190 citations
  16. Findings of the IWSLT 2022 Evaluation CampaignAntonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, et al.2022 · 177 citations
  17. Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News DomainMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.2021 · 169 citations
  18. Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentMarkus Freitag, Nitika Mathur, Chi-kiu Lo, et al.2023 · 155 citations
  19. FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGNMilind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, et al.2023 · 152 citations
  20. ChatGPT MT: Competitive for High- (but Not Low-) Resource LanguagesNathaniel Robinson, Perez Ogayo, David R. Mortensen, et al.2023 · 151 citations
  21. Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine TranslationNuno M. Guerreiro, Elena Voita, André Martins2023 · 147 citations
  22. Quality-Aware Decoding for Neural Machine TranslationPatrick Fernandes, António Farinhas, Ricardo Rei, et al.2022 · 143 citations
  23. Attributed Question Answering: Evaluation and Modeling for Attributed Large Language ModelsBernd Bohnet, Vinh Q. Tran, Pat Verga, et al.2022 · 136 citations
  24. Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language ModelsQingyu Lu, Baopu Qiu, Liang Ding, et al.2024 · 135 citations
  25. Learning Compact Metrics for MTAmy Pu, Hyung Won Chung, Ankur Parikh, et al.2021 · 130 citations
  26. Fanar: An Arabic-Centric Multimodal Generative AI PlatformFanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
  27. INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic FeedbackWenda Xu, Danqing Wang, Liangming Pan, et al.2023 · 122 citations
  28. MetricX-24: The Google Submission to the WMT 2024 Metrics Shared TaskJuraj Juraska, Daniel Deutsch, Mara Finkelstein, et al.2024 · 118 citations
  29. MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskJuraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.2023 · 118 citations
  30. Benchmarking Machine Translation with Cultural AwarenessBinwei Yao, Ming Jiang, Tara Bobinac, et al.2023 · 109 citations
  31. Leveraging GPT-4 for Automatic Translation Post-EditingVikas Raunak, Amr Sharaf, Yiren Wang, et al.2023 · 107 citations
  32. NTREX-128 – News Test References for MT Evaluation of 128 LanguagesChristian Federmann, Tom Kocmi, Ying Xin2022 · 104 citations
  33. LENS: A Learnable Evaluation Metric for Text SimplificationMounica Maddela, Yao Dou, David Heineman, et al.2023 · 103 citations
  34. Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq GenerationHeming Xia, Tao Ge, Peiyi Wang, et al.2023 · 102 citations
  35. Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering EvaluationJannis Bulian, Christian Buck, Wojciech Gajewski, et al.2022 · 100 citations
  36. UniTE: Unified Translation EvaluationYu Wan, Dayiheng Liu, Baosong Yang, et al.2022 · 100 citations
  37. Unbabel's Participation in the WMT20 Metrics Shared TaskRicardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 98 citations
  38. Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank AdaptationHaonan Li, Fajri Koto, Minghao Wu, et al.2023 · 95 citations
  39. Findings of the WMT 2022 Shared Task on Quality EstimationChrysoula Zerva, Frédéric Blain, Ricardo Rei, et al.2022 · 91 citations
  40. LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language ModelsAdian Liusie, Potsawee Manakul, Mark Gales2024 · 86 citations
  41. Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM AssessmentVyas Raina, Adian Liusie, Mark Gales2024 · 85 citations
  42. Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMRachel Bawden, François Yvon2023 · 85 citations
  43. Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared TaskRicardo Rei, Ana C Farinha, Chrysoula Zerva, et al.2021 · 85 citations
  44. Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language GenerationPatrick Fernandes, Aman Madaan, Emmy Liu, et al.2023 · 84 citations
  45. Chain-of-Dictionary Prompting Elicits Translation in Large Language ModelsHongyuan Lu, Haoran Yang, Haoyang Huang, et al.2024 · 81 citations
  46. Iterative Translation Refinement with Large Language ModelsPinzhen Chen, Zhicheng Guo, Barry Haddow, et al.2024 · 73 citations
  47. Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie CalibrationDaniel Deutsch, George Foster, Markus Freitag2023 · 73 citations
  48. Calibrating LLM-Based EvaluatorYuxuan Liu, Tianchi Yang, Shaohan Huang, et al.2024 · 71 citations
  49. IrokoBench: A New Benchmark for African Languages in the Age of Large Language ModelsDavid Ifeoluwa Adelani, Jessica Ojo, Israel Abebe Azime, et al.2025 · 69 citations
  50. Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level MetricGiorgos Vernikos, Brian Thompson, Prashant Mathur, et al.2022 · 68 citations
  51. A Fine-Grained Analysis of BERTScoreMichael Hanna, Ondřej Bojar2021 · 62 citations
  52. TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic VarietiesKarima Kadaoui, Samar M. Magdy, Abdul Waheed, et al.2023 · 60 citations
  53. Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared TaskThibault Sellam, Amy Pu, Hyung Won Chung, et al.2020 · 55 citations
  54. DiscoScore: Evaluating Text Generation with BERT and Discourse CoherenceWei Zhao, Michael Strube, Steffen Eger2023 · 53 citations
  55. Fine-Tuned Machine Translation Metrics Struggle in Unseen DomainsVilém Zouhar, Shuoyang Ding, Anna Currey, et al.2024 · 32 citations
  56. MaTESe: Machine Translation Evaluation as a Sequence Tagging ProblemStefano Perrella, Lorenzo Proietti, Alessandro Scirè, et al.2022 · 32 citations
  57. ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation MetricsChantal Amrhein, Nikita Moghe, Liane Guillou2022 · 29 citations
  58. Machine Translation Meta Evaluation through Translation Accuracy Challenge SetsNikita Moghe, Arnisa Fazla, Chantal Amrhein, et al.2025 · 28 citations
  59. M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation EvaluationZhaopeng Feng, Jiayuan Su, Jiamei Zheng, et al.2025 · 24 citations
  60. Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!Stefano Perrella, Lorenzo Proietti, Alessandro Scirè, et al.2024 · 24 citations
  61. GuoFeng: A Benchmark for Zero Pronoun Recovery and TranslationMingzhou Xu, Longyue Wang, Derek F. Wong, et al.2022 · 18 citations
  62. Lost in Translationese? Reducing Translation Effect Using Abstract Meaning RepresentationShira Wein, Nathan Schneider2024 · 16 citations
  63. Beyond Correlation: Interpretable Evaluation of Machine Translation MetricsStefano Perrella, Lorenzo Proietti, Pere-Lluís Huguet Cabot, et al.2024 · 15 citations
  64. TigerCoder: A Novel Suite of LLMs for Code Generation in BanglaNishat Raihan, Antonios Anastasopoulos, Marcos Zampieri2026 · 13 citations
  65. SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?Senyu Li, Jiayi Wang, Felermino D. M. A. Ali, et al.2025 · 13 citations
  66. TriFine: A Large-Scale Dataset of Vision-Audio-Subtitle for Tri-Modal Machine Translation and Benchmark with Fine-Grained Annotated TagsBoyu Guan, Yining Zhang, Yang Zhao, et al.2025 · 9 citations
  67. Advancing Dialectal Arabic to Modern Standard Arabic Machine TranslationAbdullah Alabdullah, Lifeng Han, Chenghua Lin2025 · 8 citations
  68. Assessing the Role of Context in Chat Translation Evaluation: Is Context Helpful and Under What Conditions?Sweta Agrawal, Amin Farajian, Patrick Fernandes, et al.2024 · 8 citations
  69. Early-Exit and Instant Confidence Translation Quality EstimationVilém Zouhar, Maike Züfle, Beni Egressy, et al.2026 · 6 citations
  70. Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation EvaluationYanzhi Tian, Cunxiang Wang, Zeming Liu, et al.2026 · 5 citations
  71. MoVoC: Morphology-Aware Subword Construction for Ge'ez Script LanguagesHailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2025 · 4 citations
  72. MoVoC: Morphology-Aware Subword Construction for Geez Script LanguagesHailay Kidu Teklehaymanot, Dren Fazlija, Wolfgang Nejdl2025 · 4 citations
  73. Domain Adaptation for Arabic Machine Translation: The Case of Financial TextsEmad A. Alghamdi, Jezia Zakraoui, Fares A. Abanmy2023 · 3 citations
  74. Ara-HOPE: Human-Centric Post-Editing Evaluation for Dialectal Arabic to Modern Standard Arabic TranslationAbdullah Alabdullah, Lifeng Han, Chenghua Lin2026 · 2 citations
  75. Bridging Scientific Heritage: An Arabic — Russian Parallel Corpus and LLM Benchmark for Sustainable Knowledge TransferMullosharaf K. Arabov2026 · 2 citations
  76. Remedy-R: Generative Reasoning for Machine Translation Evaluation without Error AnnotationsShaomu Tan, Ryosuke Mitani, Ritvik Choudhary, et al.2026 · 2 citations
  77. Who Watches the Watchmen? Humans Disagree With Translation Metrics on Unseen DomainsFinn Schmidt, Jan Philip Wahle, Terry Ruas, et al.2026 · 2 citations
  78. Biases in Translation: Assessing Opinion Distortion in Machine Translated TextsNazanin Shafiabadi, François Yvon2026 · 1 citation
  79. Can LLMs Translate Italy's Language Varieties?Edoardo Signoroni, Pavel Rychlý2026 · 1 citation
  80. Hurdles of Automatic Metric for Speech Translation EvaluationVictor Eugen Zarzu, Vilem Zouhar2026 · 1 citation
  81. IIIT-BGP IWSLT 2026 Systems for Low-resource STKaustuk Pratap Singh, Dipanshu, Vedant Singh, et al.2026 · 1 citation
  82. Multilingual Communication in the Asylum Context: Evaluating LLM-Based Machine Translation with Fuzzy Match Augmentation and Adaptive NMT across Resource Conditions under Low-Data ConstraintsThomas Moerman, Arda Tezcan, Lieve Macken2026 · 1 citation
  83. PEAR: Pairwise Evaluation for Automatic Relative Scoring in Machine TranslationLorenzo Proietti, Roman Grundkiewicz, Matt Post2026 · 1 citation
  84. Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and DatasetsHanna Yukhymenko, Anton Alexandrov, Martin Vechev2026 · 1 citation
  85. Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian LanguagesAmir Hossein Yari, Kalmit Kulkarni, Ahmad Raza Khan, et al.2026 · 1 citation
  86. XQ-MEval: A Dataset with Cross-lingual Parallel Quality for Benchmarking Translation MetricsJingxuan Liu, Zhi Qu, Jin Tei, et al.2026 · 1 citation
  87. Adaptive Originality Filtering: Rejection Based Prompting and RiddleScore for Culturally Grounded Multilingual Riddle GenerationDuy Le, Kent Ziti, Evan Girard-Sun, et al.2025 · 1 citation
  88. Exploiting Task Reversibility of DRS Parsing and Generation: Challenges and Insights from a Multi-lingual PerspectiveMuhammad Saad Amin, Luca Anselma, Alessandro Mazzei2025 · 1 citation
  89. Tokenisation in Machine Translation Does Matter: The impact of different tokenisation approaches for MalteseKurt Abela, Kurt Micallef, Marc Tanti, et al.2024 · 1 citation
  90. A Practical Evaluation Method for Long-Form Simultaneous Speech-to-Speech TranslationYulin Xue, Siqi Ouyang, Lei Li2026
  91. Ancient Greek to Modern Greek Machine Translation: A Novel Benchmark and Fine-Tuning Experiments on LLMs and NMT ModelsSpyridon Mavromatis, Sokratis Sofianopoulos, Prokopis Prokopidis, et al.2026
  92. Arabic ChartSumm: An English-to-Arabic Benchmark for Metadata-to-Text SummarizationPassant Elchafei, Amany Fashwan2026
  93. Assessing and Improving Punctuation Robustness in English-Marathi Machine TranslationKaustubh Shivshankar Shejole, Sourabh Deoghare, Pushpak Bhattacharyya2026
  94. Benchmarking Arabic — Russian Machine Translation: A Comparison of Fine-tuned NMT and Few-shot LLMs under Rich Morphology and Low Lexical OverlapMullosharaf K. Arabov2026
  95. Benchmarking Large Language Models for Game Localization Quality Assurance: A Cross-Model, Cross-Lingual AnalysisMao Tian, Na Wu2026
  96. Beyond Simple Term Injection: Reasoning Models for Legal Translation in a Non-Dominant Language VarietyPaolo Di Natale, Elena Chiocchetti, Marlies Alber, et al.2026
  97. Context-8: A Data Set for Evaluating Context Sensitivity in Machine TranslationDongyue Wang, Kyo Kageura2026
  98. Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine TranslationLu Xu, Luca Moroni, Roberto Navigli2026
  99. Degree Zero of Translation: Using Interlinear Baselines to Quantify Translator InterventionMaciej Rapacz, Aleksander Smywiński-Pohl2026
  100. Diagnose, Then Repair: A Two-Stage MQM-Guided Post-Editing Framework for Domain-Specific Machine TranslationJi Hun Wang, Siyu Wu2026

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/cited-by/