Who cites «Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics» · page 2

203 papers of our library cite it, newest first: found in their bibliographies, which we read ourselves. ← the card

GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4 — 2023 · Proceedings of the Eighth Conference on Machine Translation
IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation Metrics for Indian Languages — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
L''évaluation de la traduction automatique du caractère au document : un état de l''art — 2023 · Actes de CORIA-TALN 2023. Actes des 16e Rencontres Jeunes Chercheurs en RI (RJCRI) et 25e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RÉCITAL)
MUNI-NLP Systems for Low-resource Indic Machine Translation — 2023 · Proceedings of the Eighth Conference on Machine Translation
Metric Score Landscape Challenge (MSLC23): Understanding Metrics'' Performance on a Wider Landscape of Translation Quality — 2023 · Proceedings of the Eighth Conference on Machine Translation
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
PE effort and neural-based automatic MT metrics: do they correlate? — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Rethinking Round-Trip Translation for Machine Translation Evaluation — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
TeCS: A Dataset and Benchmark for Tense Consistency of Machine Translation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Team NLLG submission for Eval4NLP 2023 Shared Task: Retrieval-Augmented In-Context Learning for NLG Evaluation — 2023 · Proceedings of the 4th Workshop on Evaluation and Comparison of NLP Systems
The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Language — 2023 · Proceedings of the 20th International Conference on Natural Language Processing (ICON)
UScore: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Boosting Code Summarization by Embedding Code Structures — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation — 2022 · Findings of the Association for Computational Linguistics: NAACL 2022
Control Prefixes for Parameter-Efficient Text Generation — 2022 · Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
DEMETR: Diagnosing Evaluation Metrics for Translation — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Does Summary Evaluation Survive Translation to Other Languages? — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark — 2022 · Transactions of the Association for Computational Linguistics
Evaluating the Examiner: The Perils of Pearson Correlation for Validating Text Similarity Metrics — 2022 · Proceedings of the 20th Annual Workshop of the Australasian Language Technology Association
Findings of the 2022 Conference on Machine Translation (WMT22) — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Improving Both Domain Robustness and Domain Adaptability in Machine Translation — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics — 2022 · Findings of the Association for Computational Linguistics: ACL 2022
Is NLP Ready for Standardization? — 2022 · Findings of the Association for Computational Linguistics: EMNLP 2022
Lack of Fluency is Hurting Your Translation Model — 2022 · arXiv:2205.11826
MS-COMET: More and Better Human Judgements Improve Metric Performance — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
Noisy Label Regularisation for Textual Regression — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
Non-Autoregressive Machine Translation: It''s Not as Fast as it Seems — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation — 2022 · Proceedings of the 29th International Conference on Computational Linguistics
Part Represents Whole: Improving the Evaluation of Machine Translation System Using Entropy Enhanced Metrics — 2022 · Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022
Pre-trained language models evaluating themselves - A comparative study — 2022 · Proceedings of the Third Workshop on Insights from Negative Results in NLP
Quality-Aware Decoding for Neural Machine Translation — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics — 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Reproducibility Issues for BERT-based Evaluation Metrics — 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust — our card · 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Searching for COMETINHO: The Little Metric That Could — 2022 · Proceedings of the 23rd Annual Conference of the European Association for Machine Translation
Searching for a Higher Power in the Human Evaluation of MT — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Spurious Correlations in Reference-Free Evaluation of Text Generation — 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
TYPIC: A Corpus of Template-Based Diagnostic Comments on Argumentation — 2022 · Proceedings of the Thirteenth Language Resources and Evaluation Conference
Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
UniTE: Unified Translation Evaluation — 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Unsupervised and Very-Low Resource Supervised Translation on German and Sorbian Variant Languages — 2022 · Proceedings of the Seventh Conference on Machine Translation (WMT)
Vacillating Human Correlation of SacreBLEU in Unprotected Languages — 2022 · Proceedings of the 2nd Workshop on Human Evaluation of NLP Systems (HumEval)
Why is sentence similarity benchmark not predictive of application-oriented task performance? — 2022 · Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems
``Hi, how can I help you?'''' Improving Machine Translation of Conversational Content in a Business Context — 2022 · Proceedings of the 23rd Annual Conference of the European Association for Machine Translation
m$^4$ Adapter: Multilingual Multi-Domain Adaptation for Machine Translation with a Meta-Adapter — 2022 · Findings of the Association for Computational Linguistics: EMNLP 2022
A Fine-Grained Analysis of BERTScore — 2021 · Proceedings of the Sixth Conference on Machine Translation
Assessing Reference-Free Peer Evaluation for Machine Translation — 2021 · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Automatic Rephrasing of Transcripts-based Action Items — 2021 · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
BARTScore: Evaluating Generated Text as Text Generation — 2021 · arXiv:2106.11520
Better than Average: Paired Evaluation of NLP systems — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Difficulty-Aware Machine Translation Evaluation — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
Evaluating the Efficacy of Summarization Evaluation across Languages — 2021 · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Evaluating the Morphosyntactic Well-formedness of Generated Texts — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Findings of the WMT 2021 Shared Tasks in Unsupervised MT and Very Low Resource Supervised MT — 2021 · Proceedings of the Sixth Conference on Machine Translation
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Grounding as a Collaborative Process — 2021 · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume
Learning Compact Metrics for MT — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Like Chalk and Cheese? On the Effects of Translationese in MT Training — 2021 · Proceedings of Machine Translation Summit XVIII: Research Track
Machine Translation into Low-resource Language Varieties — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
Macro-Average: Rare Types Are Important Too — 2021 · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
NRC-CNRC Machine Translation Systems for the 2021 AmericasNLP Shared Task — 2021 · Proceedings of the First Workshop on Natural Language Processing for Indigenous Languages of the Americas
On the Stability of System Rankings at WMT — 2021 · Proceedings of the Sixth Conference on Machine Translation
Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Perturbation CheckLists for Evaluating NLG Evaluation Metrics — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain — 2021 · Proceedings of the Sixth Conference on Machine Translation
Reward Optimization for Neural Machine Translation with Learned Metrics — 2021 · arXiv:2104.07541
RoBLEURT Submission for WMT2021 Metrics Task — 2021 · Proceedings of the Sixth Conference on Machine Translation
Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Sentiment-Aware Measure (SAM) for Evaluating Sentiment Transfer by Machine Translation Systems — 2021 · Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021)
Shades of BLEU, Flavours of Success: The Case of MultiWOZ — 2021 · Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
The (Un)Suitability of Automatic Evaluation Metrics for Text Simplification — 2021 · Computational Linguistics
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics — 2021 · Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
The LMU Munich System for the WMT 2021 Large-Scale Multilingual Machine Translation Shared Task — 2021 · Proceedings of the Sixth Conference on Machine Translation
The statistical advantage of automatic NLG metrics at the system level — 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation — 2021 · Proceedings of the Sixth Conference on Machine Translation
Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR — our card · 2021 · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume
What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers — 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text Systems — 2020 · Proceedings of the 13th International Conference on Natural Language Generation
Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing — 2020 · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale — 2020 · Proceedings of the 28th International Conference on Computational Linguistics
Disentangling the Properties of Human Evaluation Methods: A Classification System to Support Comparability, Meta-Evaluation and Reproducibility Testing — 2020 · Proceedings of the 13th International Conference on Natural Language Generation
Evaluation of Text Generation: A Survey — 2020 · arXiv:2006.14799
Evaluation rules! On the use of grammars and rule-based systems for NLG evaluation — 2020 · Proceedings of the 1st Workshop on Evaluating NLG Evaluation
Findings of the WMT 2020 Biomedical Translation Shared Task: Basque, Italian and Russian as New Additional Languages — 2020 · Proceedings of the Fifth Conference on Machine Translation
Gradations of Error Severity in Automatic Image Descriptions — 2020 · Proceedings of the 13th International Conference on Natural Language Generation
KoBE: Knowledge-Based Machine Translation Evaluation — our card · 2020 · Findings of the Association for Computational Linguistics: EMNLP 2020
Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task — 2020 · Proceedings of the Fifth Conference on Machine Translation
Neural Machine Translation between similar South-Slavic languages — 2020 · Proceedings of the Fifth Conference on Machine Translation
Neural Machine Translation for translating into Croatian and Serbian — 2020 · Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects
ParBLEU: Augmenting Metrics with Automatic Paraphrases for the WMT''20 Metrics Shared Task — 2020 · Proceedings of the Fifth Conference on Machine Translation