Who cites «Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics»

203 papers of our library cite it, newest first: found in their bibliographies, which we read ourselves. ← the card

A Critical Study of Automatic Evaluation in Sign Language Translation — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
Automated evaluation of LLMs for effective machine translation of Mandarin Chinese to English — 2026 · arXiv:2603.09998
Benchmarking Speech-to-Speech Translation Models — 2026 · arXiv:2606.03241
Can We Triage LLM Translation Errors in Classical Texts Without Human References? Source Novelty, GEMBA Scoring, and Budgeted Review through Pali-to-English Translation — 2026 · arXiv:2609.14963
Contextual Diversity Measure (CDM) for Controllable Story Generation in Large Language Models — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
Creativity Bias: How Machine Evaluation Struggles with Creativity in Literary Translations — 2026 · Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1)
Debate, Deliberate, Decide (D3): A Cost-Aware Adversarial Framework for Reliable and Interpretable LLM Evaluation — 2026 · Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Diagnose, Then Repair: A Two-Stage MQM-Guided Post-Editing Framework for Domain-Specific Machine Translation — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
From Outliers to Errors: Auditing Pali-to-English LLM Translations with Multi-Reference Adjudication — 2026 · arXiv:2606.01136
LIMP: Linguistically-Informed Multi-Strategy Prompting for Telugu Multi-Turn Dialogue Generation — 2026 · Proceedings of the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages
M-GATE: Multilingual Grammar, Accuracy in Translation, and Efficiency Benchmark for Large Language Models — 2026 · arXiv:2608.03803
Mind Which Bird You Favour: Parameterizing Adequacy-Fluency Balance in Meta-Evaluation of Machine Translation — 2026 · arXiv:2609.14795
NLG Evaluation: Past, Present, Future — 2026 · Proceedings of the 1st Symposium on Natural Language Generation Evaluations
Pressure-Testing Deception Probes in LLMs: Scaling, Robustness, and the Geometry of Deceptive Representations — 2026 · Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)
Referenceless Evaluation of Machine Translation Models by Ranking Performance in Romanian to English Translate-train Settings — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
Report-based Recommendations for Policy Making and Agency Operations: Dataset and LLM Evaluation — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
ReproHum \#0033-05: Human Evaluation Report on ``Generating Scientific Definitions with Controllable Complexity — 2026 · Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)
SemiAdapt: Semi-Supervised and Efficient LoRA-Based Domain Adaptation for Low-Resource Irish Machine Translation with Transformers — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
SrcMix: Mixing of Related Source Languages Benefits Extremely Low-resource Machine Translation — 2026 · Findings of the Association for Computational Linguistics: EACL 2026
TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation — 2026 · arXiv:2608.02975
The American Palimpsest: Quantifying South Asian English Dialect Erasure in LLMs — 2026 · Proceedings of the 4th Workshop on Cross-Cultural Considerations in NLP (C3NLP 2026)
Unified Multi-Dialectal Neural Machine Translation for Bangla Using the Dwadash Benchmark Corpus — 2026 · arXiv:2608.12018
Who Watches the Watchmen? Humans Disagree With Translation Metrics on Unseen Domains — 2026 · Findings of the Association for Computational Linguistics: ACL 2026
``A Sacred Bird Called the Phoenix''''. Auditing the most-used Parallel Corpus for German Sign Language Recognition and Translation — 2026 · Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion
``Be My Cheese?'''': Cultural Nuance Benchmarking for Machine Translation in Multilingual LLMs — 2026 · Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)
Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation — 2025 · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
BLEUBERI: BLEU is a surprisingly effective reward for instruction following — 2025 · arXiv:2505.11080
Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases — 2025 · Proceedings of the First Workshop on Large Language Model Memorization (L2M2)
Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translation — 2025 · arXiv:2509.17349
Character-Aware English-to-Japanese Translation of Fictional Dialogue Using Speaker Embeddings and Back-Translation — 2025 · Proceedings of the Tenth Conference on Machine Translation
Context-Informed Machine Translation of Manga using Multimodal Large Language Models — 2025 · Proceedings of the 31st International Conference on Computational Linguistics
D\''ej\`a Vu: Multilingual LLM Evaluation through the Lens of Machine Translation Evaluation — 2025 · arXiv:2504.11829
Do LLMs Understand Your Translations? Evaluating Paragraph-level MT with Question Answering — 2025 · arXiv:2504.07583
Do Large Language Models understand how to be judges? — 2025 · Proceedings of the 2nd LUHME Workshop
Don''t Sweat the Small Stuff: Segment-Level Meta-Evaluation Based on Pairwise Difference Correlation — 2025 · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Estimating Machine Translation Difficulty — 2025 · Findings of the Association for Computational Linguistics: EMNLP 2025
Evaluating the Feasibility of Using ChatGPT for Cross-cultural Survey Translation — 2025 · Proceedings of the 21st Conference on Natural Language Processing (KONVENS 2025): Long and Short Papers
Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks — 2025 · Proceedings of the 31st International Conference on Computational Linguistics
Findings of the AmericasNLP 2025 Shared Tasks on Machine Translation, Creation of Educational Material, and Translation Metrics for Indigenous Languages of the Americas — 2025 · Proceedings of the Fifth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP)
Findings of the WAT 2025 Shared Task on Japanese-English Article-level News Translation — 2025 · Proceedings of the Twelfth Workshop on Asian Translation (WAT 2025)
Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets — 2025 · Proceedings of the Tenth Conference on Machine Translation
Findings of the WMT25 Multilingual Instruction Shared Task: Persistent Hurdles in Reasoning, Generation, and Evaluation — 2025 · Proceedings of the Tenth Conference on Machine Translation
Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help — 2025 · Proceedings of the Tenth Conference on Machine Translation
How to Evaluate Speech Translation with Source-Aware Neural MT Metrics — 2025 · arXiv:2511.03295
Investigating Length Issues in Document-level Machine Translation — 2025 · Proceedings of Machine Translation Summit XX: Volume 1
MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators — 2025 · Proceedings of the 31st International Conference on Computational Linguistics
MSLC25: Metric Performance on Low-Quality Machine Translation, Empty Strings, and Language Variants — 2025 · Proceedings of the Tenth Conference on Machine Translation
NHK Submission to WAT 2025: Leveraging Preference Optimization for Article-level Japanese–English News Translation — 2025 · Proceedings of the Twelfth Workshop on Asian Translation (WAT 2025)
SemiAdapt and SemiLoRA: Efficient Domain Adaptation for Transformer-based Low-Resource Language Translation with a Case Study on Irish — 2025 · arXiv:2510.18725
The Devil is in the Details: Assessing the Effects of Machine-Translation on LLM Performance in Domain-Specific Texts — 2025 · Proceedings of Machine Translation Summit XX: Volume 1
The Illusion of a Perfect Metric: Why Evaluating AI ́S Words Is Harder than It Looks — 2025 · Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
Towards Zero-Shot Multimodal Machine Translation — 2025 · Findings of the Association for Computational Linguistics: NAACL 2025
Training and Inference Efficiency of Encoder-Decoder Speech Models — 2025 · arXiv:2503.05931
TransEvalnia: Reasoning-based Evaluation and Ranking of Translations — 2025 · arXiv:2507.12724
Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Verify with Caution: The Pitfalls of Relying on Imperfect Factuality Metrics — 2025 · Findings of the Association for Computational Linguistics: ACL 2025
Évaluation de la Robustesse des LLM : Proposition d''un Cadre Méthodologique et Développement d''un Benchmark — 2025 · Actes de l'atelier Évaluation des modèles génératifs (LLM) et challenge 2025 (EvalLLM)
A Call for Clarity in Beam Search: How It Works and When It Stops — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
An Analysis on Automated Metrics for Evaluating Japanese-English Chat Translation — 2024 · arXiv:2412.18190
Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics — our card · 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
COMET for Low-Resource Machine Translation Evaluation: A Case Study of English-Maltese and Spanish-Basque — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Efficient Benchmarking (of Language Models) — 2024 · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
Evaluating Automatic Metrics with Incremental Machine Translation Systems — 2024 · Findings of the Association for Computational Linguistics: EMNLP 2024
Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Finding Blind Spots in Evaluator LLMs with Interpretable Checklists — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet — 2024 · Proceedings of the Ninth Conference on Machine Translation
Humanistic Buddhism Corpus: A Challenging Domain-Specific Dataset of English Translations for Classical and Modern Chinese — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy — 2024 · Proceedings of the Ninth Conference on Machine Translation
Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis — 2024 · Proceedings of the Ninth Conference on Machine Translation
Kreyòl-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages — 2024 · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
LIRE: listwise reward enhancement for preference alignment — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
Long-Form Analogy Evaluation Challenge — 2024 · Proceedings of the 17th International Natural Language Generation Conference: Generation Challenges
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
On Creating an English-Thai Code-switched Machine Translation in Medical Domain — 2024 · Findings of the Association for Computational Linguistics: EMNLP 2024
Pushing the Limits of Zero-shot End-to-End Speech Translation — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Revisiting Meta-evaluation for Grammatical Error Correction — 2024
Self-Evaluation of Large Language Model based on Glass-box Features — 2024 · Findings of the Association for Computational Linguistics: EMNLP 2024
Some Tradeoffs in Continual Learning for Parliamentary Neural Machine Translation Systems — 2024 · Proceedings of the 16th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilities — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Topic-guided Example Selection for Domain Adaptation in LLM-based Machine Translation — 2024 · Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Languages — 2024 · arXiv:2404.02512
À propos des difficultés de traduire automatiquement de longs documents — 2024 · Actes de la 31ème Conférence sur le Traitement Automatique des Langues Naturelles, volume 1 : articles longs et prises de position
Adapting Machine Translation Education to the Neural Era: A Case Study of MT Quality Assessment — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
Analysing Mistranslation of Emotions in Multilingual Tweets by Online MT Tools — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Beyond Correlation: Making Sense of the Score Differences of New MT Evaluation Metrics — 2023 · Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track
Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation — 2023
Calibrated Interpretation: Confidence Estimation in Semantic Parsing — 2023
Correction of Errors in Preference Ratings from Automated Metrics for Text Generation — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
Delving into Evaluation Metrics for Generation: A Thorough Assessment of How Metrics Generalize to Rephrasing Across Languages — 2023 · Proceedings of the 4th Workshop on Evaluation and Comparison of NLP Systems
Enhancing factualness and controllability of Data-to-Text Generation via data Views and constraints — 2023 · Proceedings of the 16th International Natural Language Generation Conference
Extrinsic Evaluation of Machine Translation Metrics — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet — 2023 · Proceedings of the Eighth Conference on Machine Translation