🧑‍🔬 Chi-kiu Lo — all works

35 works · ← Chi-kiu Lo

1. Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More RobustMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.Machine translation · 265 citations
2. YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available ResourcesConference on Machine Translation (WMT)Chi-kiu Lo2019 · 219 citations
3. Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News DomainConference on Machine Translation (WMT)Markus Freitag, Ricardo Rei, Nitika Mathur, et al.2021 · 169 citations
4. Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.2023 · 155 citations
5. MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic rolesChi-kiu Lo, Dekai WuMachine translation · 135 citations
6. Fully Automatic Semantic MT Evaluation ↗Proceedings of the Seventh Workshop on Statistical Machine Translation · no summary yetChi-kiu Lo, Anand Karthik Tumuluru, Dekai Wu2012 · 113 citations
7. Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared TaskConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Daniel Deutsch, et al.2024 · 107 citations
8. MEANT 2.0: Accurate semantic MT evaluation for any output languageChi-kiu LoMachine translation · 82 citations
9. Accurate semantic textual similarity for cleaning noisy parallel corpora using semantic machine translation evaluation metric: The NRC supervised submissions to the Parallel Corpus Filtering task ↗Proceedings of the Third Conference on Machine Translation: Shared Task Papers · no summary yetChi-kiu Lo et al.2018 · 47 citations
10. XMEANT: Better semantic MT evaluation without reference translations ↗Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetChi-kiu Lo et al.2014 · 44 citations
11. Improving machine translation by training against an automatic semantic frame based evaluation metric ↗Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetChi-kiu Lo et al.2013 · 40 citations
12. Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help ↗Proceedings of the Tenth Conference on Machine Translation · no summary yetAlon Lavie et al.2025 · 39 citations
13. Unsupervised vs. supervised weight estimation for semantic MT evaluation metrics ↗Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yetChi-kiu Lo, Dekai Wu2012 · 37 citations
14. MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric ↗Proceedings of the Eighth Workshop on Statistical Machine Translation · no summary yetChi-kiu Lo, Dekai Wu2013 · 31 citations
15. Can Informal Genres be better Translated by Tuning on Automatic Semantic Metrics? ↗Proceedings of Machine Translation Summit XIV: Papers · no summary yetChi-Kiu Lo, Dekai Wu2013 · 28 citations
16. Extended Study on Using Pretrained Language Models and YiSi-1 for Machine Translation Evaluation ↗Proceedings of the Fifth Conference on Machine Translation · no summary yetLo, Chi-kiu2020 · 23 citations
17. Structured vs. Flat Semantic Role Representations for Machine Translation Evaluation ↗Proceedings of Fifth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yetChi-kiu Lo, Dekai Wu2011 · 23 citations
18. Accuracy and robustness in measuring the lexical similarity of semantic role fillers for automatic semantic MT evaluation ↗Proceedings of the 26th Pacific Asia Conference on Language, Information, and Computation · no summary yetAnand Karthik Tumuluru, Chi-kiu Lo, Dekai Wu2012 · 20 citations
19. LTG vs. ITG Coverage of Cross-Lingual Verb Frame Alternations ↗Proceedings of the 16th Annual Conference of the European Association for Machine Translation · no summary yetKarteek Addanki et al.2012 · 19 citations
20. Evaluating Machine Translation Utility via Semantic Role Labels ↗Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10) · no summary yetChi-kiu Lo, Dekai Wu2010 · 18 citations
21. Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality ↗Proceedings of the Eighth Conference on Machine Translation · no summary yetChi-kiu Lo, Samuel Larkin, Rebecca Knowles2023 · 16 citations
22. Improving evaluation and optimization of MT systems against MEANT ↗Proceedings of the Tenth Workshop on Statistical Machine Translation · no summary yetChi-kiu Lo, Philipp Dowling, Dekai Wu2015 · 14 citations
23. Machine Translation Reference-less Evaluation using YiSi-2 with Bilingual Mappings of Massive Multilingual Language Model ↗Proceedings of the Fifth Conference on Machine Translation · no summary yetChi-kiu Lo, Samuel Larkin2020 · 12 citations
24. Semantic vs. Syntactic vs. N-gram Structure for Machine Translation Evaluation ↗Proceedings of the 4th Workshop on Syntax and Structure in Statistical Translation · no summary yetChi-kiu Lo, Dekai Wu2010 · 10 citations
25. Beyond Correlation: Making Sense of the Score Differences of New MT Evaluation Metrics ↗Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track · no summary yetChi-kiu Lo, Rebecca Knowles, Cyril Goutte2023 · 9 citations
26. MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality ↗Proceedings of the Ninth Conference on Machine Translation · no summary yetRebecca Knowles, Samuel Larkin, Chi-Kiu Lo2024 · 7 citations
27. On the reliability and inter-annotator agreement of human semantic MT evaluation via HMEANT ↗Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14) · no summary yetChi-kiu Lo, Dekai Wu2014 · 5 citations
28. Evaluation Briefs: Drawing on Translation Studies for Human Evaluation of MT ↗Proceedings of the 16th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track) · no summary yetTing Liu et al.2024 · 4 citations
29. Machine Translation Metrics for Indigenous Languages Using Fine-tuned Semantic Embeddings ↗Proceedings of the Fifth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP) · no summary yetNathaniel Krasner et al.2025 · 3 citations
30. Better Semantic Frame Based MT Evaluation via Inversion Transduction Grammars ↗Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · no summary yetDekai Wu et al.2014 · 3 citations
31. MSLC25: Metric Performance on Low-Quality Machine Translation, Empty Strings, and Language Variants ↗Proceedings of the Tenth Conference on Machine Translation · no summary yetRebecca Knowles, Samuel Larkin, Chi-Kiu Lo2025 · 1 citation
32. In the Blind: Building Pseudo-References for MT Evaluation ↗arXiv:2609.13611 · no summary yetDiptesh Kanojia et al.2026
33. Data Sampling and (In)stability in Machine Translation Evaluation ↗Findings of the Association for Computational Linguistics: ACL 2023 · no summary yetChi-kiu Lo, Rebecca Knowles2023
34. Lexical Access Preference and Constraint Strategies for Improving Multiword Expression Association within Semantic MT Evaluation ↗Proceedings of the 4th Workshop on Cognitive Aspects of the Lexicon (CogALex) · no summary yetDekai Wu, Chi-kiu Lo, Markus Saers2014
35. Human semantic MT evaluation with HMEANT for IWSLT 2013 ↗Proceedings of the 10th International Workshop on Spoken Language Translation: Evaluation Campaign · no summary yetChi-kiu Lo, Dekai Wu2013

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/chi-kiu-lo/works/