Who cites «Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation» · page 4

395 papers of our library cite it, newest first: found in their bibliographies, which we read ourselves. ← the card

Thresh: A Unified, Customizable and Deployable Platform for Fine-Grained Text Evaluation — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Towards Explainable Evaluation Metrics for Machine Translation — 2023 · arXiv:2306.13041 · Journal of Machine Learning Research (JMLR), 2024, vol. 25, no. 75, p. 1-49
Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors — 2023 · arXiv:2302.08975
Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Language — 2023 · Proceedings of the 20th International Conference on Natural Language Processing (ICON)
Towards Unsupervised Recognition of Token-level Semantic Differences in Related Documents — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Toxicity in Multilingual Machine Translation at Scale — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level — 2023 · Proceedings of the Eighth Conference on Machine Translation
UScore: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation — 2023 · Proceedings of the Eighth Conference on Machine Translation
eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings — 2023 · Proceedings of the Eighth Conference on Machine Translation
A Comparison of Data Filtering Methods for Neural Machine Translation — 2022 · Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas (Volume 2: Users and Providers Track and Government Track)
A Natural Diet: Towards Improving Naturalness of Machine Translation Output — 2022 · Findings of the Association for Computational Linguistics: ACL 2022
A new approach to calculating BERTScore for automatic assessment of translation quality — 2022 · arXiv:2203.05598
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics — our card · 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Alibaba-Translate China's Submission for WMT 2022 Metrics Shared Task — 2022 · arXiv:2210.09683
Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Alibaba-Translate China's Submission for WMT2022 Metrics Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
An Overview on Machine Translation Evaluation — 2022 · arXiv:2202.11027
As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive Conditioning — 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Automatic Correction of Human Translations — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
BJTU-Toshiba's Submission to WMT22 Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Consistent Human Evaluation of Machine Translation across Language Pairs — 2022 · Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
Disentangling Uncertainty in Machine Translation Evaluation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Does Summary Evaluation Survive Translation to Other Languages? — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Efficient Machine Translation Corpus Generation — 2022 · Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Workshop 2: Corpus Generation and Corpus Augmentation for Machine Translation)
Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level Metric — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Error Analysis of ToTTo Table-to-Text Neural NLG Models — 2022 · Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark — 2022 · Transactions of the Association for Computational Linguistics
Evaluating Machine Translation in Cross-lingual E-Commerce Search — 2022 · Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
Examining Large Pre-Trained Language Models for Machine Translation: What You Don''t Know about It — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Findings of the 2022 Conference on Machine Translation (WMT22) — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22) — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Findings of the IWSLT 2022 Evaluation Campaign — 2022 · Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022)
Findings of the WMT 2022 Shared Task on Chat Translation — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Findings of the WMT 2022 Shared Task on Efficient Translation — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
From COMET to COMES – Can Summary Evaluation Benefit from Translation Evaluation? — 2022 · Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems
GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
HOPE: A Task-Oriented and Human-Centric Evaluation Framework Using Professional Post-Editing Towards More Effective MT Evaluation — 2022 · Proceedings of the Thirteenth Language Resources and Evaluation Conference
High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics — 2022 · Transactions of the Association for Computational Linguistics
HilMeMe: A Human-in-the-Loop Machine Translation Evaluation Metric Looking into Multi-Word Expressions — 2022 · arXiv:2211.05201
Identifying Weaknesses in Machine Translation Metrics Through Minimum Bayes Risk Decoding: A Case Study for COMET — 2022 · Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
MS-COMET: More and Better Human Judgements Improve Metric Performance — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Measuring Uncertainty in Translation Quality Evaluation (TQE) — 2022 · Proceedings of the Thirteenth Language Resources and Evaluation Conference
Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents — 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
NJUNLP's Participation for the WMT2022 Quality Estimation Shared Task — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis — 2022 · Findings of the Association for Computational Linguistics: EMNLP 2022
On Decoding Strategies for Neural Text Generators — 2022 · Transactions of the Association for Computational Linguistics
On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
On reporting scores and agreement for error annotation tasks — 2022 · Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
On the Effectiveness of Automated Metrics for Text Generation Systems — 2022 · Findings of the Association for Computational Linguistics: EMNLP 2022
One Embedder, Any Task: Instruction-Finetuned Text Embeddings — 2022 · arXiv:2212.09741
Quality Scoring of Source Words in Neural Translation Models — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Quality-Aware Decoding for Neural Machine Translation — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text — 2022 · arXiv:2202.06935
Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust — our card · 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Rethink about the Word-level Quality Estimation for Machine Translation from Human Judgement — 2022 · arXiv:2209.05695
Searching for COMETINHO: The Little Metric That Could — 2022 · Proceedings of the 23rd Annual Conference of the European Association for Machine Translation
Searching for a Higher Power in the Human Evaluation of MT — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Survey of Low-Resource Machine Translation — 2022 · Computational Linguistics
TRUE: Re-evaluating Factual Consistency Evaluation — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
The Cross-lingual Conversation Summarization Challenge — 2022 · Proceedings of the 15th International Conference on Natural Language Generation: Generation Challenges
Toward More Effective Human Evaluation for Machine Translation — 2022 · Proceedings of the 2nd Workshop on Human Evaluation of NLP Systems (HumEval)
Translation Error Detection as Rationale Extraction — 2022 · Findings of the Association for Computational Linguistics: ACL 2022
Transparent Human Evaluation for Image Captioning — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Twist Decoding: Diverse Generators Guide Each Other — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared Task — 2021 · Proceedings of the Sixth Conference on Machine Translation
Attainable Text-to-Text Machine Translation vs. Translation: Issues Beyond Linguistic Processing — 2021 · Proceedings of Machine Translation Summit XVIII: Research Track
Findings of the 2021 Conference on Machine Translation (WMT21) — 2021 · Proceedings of the Sixth Conference on Machine Translation
Just Ask! Evaluating Machine Translation by Asking and Answering Questions — 2021 · Proceedings of the Sixth Conference on Machine Translation
Learning Compact Metrics for MT — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Learning with Different Amounts of Annotation: From Zero to Many Labels — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
MTEQA at WMT21 Metrics Shared Task — 2021 · Proceedings of the Sixth Conference on Machine Translation
On nature and causes of observed MT errors — 2021 · Proceedings of Machine Translation Summit XVIII: Research Track
On the Challenges of Evaluating Compositional Explanations in Multi-Hop Inference: Relevance, Completeness, and Expert Ratings — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
On the Stability of System Rankings at WMT — 2021 · Proceedings of the Sixth Conference on Machine Translation
Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Perturbation CheckLists for Evaluating NLG Evaluation Metrics — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Regressive Ensemble for Machine Translation Quality Evaluation — 2021 · Proceedings of the Sixth Conference on Machine Translation
Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain — 2021 · Proceedings of the Sixth Conference on Machine Translation
The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results — 2021 · Proceedings of the 2nd Workshop on Evaluation and Comparison of NLP Systems
The statistical advantage of automatic NLG metrics at the system level — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation — 2021 · Proceedings of the Sixth Conference on Machine Translation
Uncertainty-Aware Machine Translation Evaluation — 2021 · Findings of the Association for Computational Linguistics: EMNLP 2021
Underreporting of errors in NLG output, and what to do about it — 2021 · Proceedings of the 14th International Conference on Natural Language Generation
What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
cushLEPOR: customising hLEPOR metric using Optuna for higher agreement with human judgments or pre-trained language model LaBSE — 2021 · Proceedings of the Sixth Conference on Machine Translation
Meta-Evaluation of Translation Evaluation Methods: a systematic up-to-date overview — 2016 · arXiv:1605.04515