Who cites «Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation» · page 3
395 papers of our library cite it, newest first: found in their bibliographies, which we read ourselves. ← the card
- Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Learning from others'' mistakes: Finetuning machine translation models with span-level error annotations — 2024 · arXiv:2410.16509
- Lessons from the Trenches on Reproducible Evaluation of Language Models — 2024 · arXiv:2405.14782
- Leveraging Large Language Models for NLG Evaluation: Advances and Challenges — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Likelihood-based Mitigation of Evaluation Bias in Large Language Models — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- MT-Ranker: Reference-free machine translation evaluation by inter-system ranking — 2024 · arXiv:2401.17099
- MTUncertainty: Assessing the Need for Post-editing of Machine Translation Outputs by Fine-tuning OpenAI LLMs — 2024 · Proceedings of the 25th Annual Conference of the European Association for Machine Translation (Volume 1)
- Measuring Uncertainty in Neural Machine Translation with Similarity-Sensitive Entropy — 2024 · Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task — 2024 · Proceedings of the Ninth Conference on Machine Translation
- Mitigating Metric Bias in Minimum Bayes Risk Decoding — 2024 · Proceedings of the Ninth Conference on Machine Translation
- Multi-Dimensional Machine Translation Evaluation: Model Evaluation and Resource for Korean — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- NEO-BENCH: Evaluating Robustness of Large Language Models with Neologisms — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Neuron Specialization: Leveraging Intrinsic Task Modularity for Multilingual Machine Translation — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- On the Implications of Verbose LLM Outputs: A Case Study in Translation Evaluation — 2024 · arXiv:2410.00863
- POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Position Paper: Should Machine Translation be Labelled as AI-Generated Content? — 2024 · Proceedings of the 16th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
- Pre-task perceptions of MT influence quality and productivity: the importance of better translator-computer interactions and implications for training — 2024 · Proceedings of the 25th Annual Conference of the European Association for Machine Translation (Volume 1)
- Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Quality and Quantity of Machine Translation References for Automatic Metrics — 2024 · Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024
- Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- ReproHum \#0033-3: Comparable Relative Results with Lower Absolute Values in a Reproduction Study — 2024 · Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024
- ReproHum: \#0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August et al. 2022 — 2024 · Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024
- Rewarding What Matters: Step-by-Step Reinforcement Learning for Task-Oriented Dialogue — 2024 · Findings of the Association for Computational Linguistics: EMNLP 2024
- Simpson's Paradox and the Accuracy-Fluency Tradeoff in Translation — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- TMU-HIT''s Submission for the WMT24 Quality Estimation Shared Task: Is GPT-4 a Good Evaluator for Machine Translation? — 2024 · Proceedings of the Ninth Conference on Machine Translation
- The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilities — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Towards Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST) — 2024 · arXiv:2412.18367
- Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Languages — 2024 · arXiv:2404.02512
- Towards Multiple References Era – Addressing Data Leakage and Limited Reference Diversity in Machine Translation Evaluation — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Towards Precise Localization of Critical Errors in Machine Translation — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Towards a More Comprehensive Evaluation for Italian LLMs — 2024 · Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024)
- TransAgents: Build Your Translation Company with Language Agents — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- What Have We Achieved on Non-autoregressive Translation? — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Word-level Translation Quality Estimation Based on Optimal Transport — 2024 · Proceedings of the 16th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
- adaptMLLM: Fine-Tuning Multilingual Language Models on Low-Resource Languages with Integrated LLM Playgrounds — 2024 · arXiv:2403.02370 · Information 2023, 14(12), 638
- chrF-S: Semantics Is All You Need — 2024 · Proceedings of the Ninth Conference on Machine Translation
- xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection — 2024 · Transactions of the Association for Computational Linguistics
- A Critical Evaluation of Evaluations for Long-form Question Answering — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- An Experiment in Error Analysis of Real-time Speech Machine Translation Using the Example of the European Parliament's Innovation Partnership — 2023 · Proceedings of the Ninth Italian Conference on Computational Linguistics (CLiC-it 2023)
- Are Experts Needed? On Human Evaluation of Counselling Reflection Generation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ — 2023 · arXiv:2310.00367 · The Twelfth International Conference on Learning Representations, 2024
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models — 2023 · arXiv:2309.06085
- Barriers and enabling factors for error analysis in NLG research — 2023 · Northern European Journal of Language Technology
- Beyond Correlation: Making Sense of the Score Differences of New MT Evaluation Metrics — 2023 · Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track
- BooookScore: A systematic exploration of book-length summarization in the era of LLMs — 2023 · arXiv:2310.00785
- Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation — 2023
- C-XNLI: Croatian Extension of XNLI Dataset — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- CCEval: A Representative Evaluation Benchmark for the Chinese-centric Multilingual Machine Translation — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- Empirical Assessment of kNN-MT for Real-World Translation Scenarios — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Evaluating Optimal Reference Translations — 2023 · arXiv:2311.16787
- EvolveMT: an Ensemble MT Engine Improving Itself with Usage Only — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 5: Industry Track)
- Explaining with Contrastive Phrasal Highlighting: A Case Study in Assisting Humans to Detect Translation Differences — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Extrinsic Evaluation of Machine Translation Metrics — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN — 2023 · Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)
- FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation — 2023 · Transactions of the Association for Computational Linguistics
- Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Findings of the WMT 2023 Shared Task on Quality Estimation — 2023 · Proceedings of the Eighth Conference on Machine Translation
- GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4 — 2023 · Proceedings of the Eighth Conference on Machine Translation
- GPTScore: Evaluate as You Desire — 2023 · arXiv:2302.04166
- How effective is machine translation on low-resource code-switching? A case study comparing human and automatic metrics — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- IOL Research's Submission for WMT 2023 Quality Estimation Shared Task — 2023 · Proceedings of the Eighth Conference on Machine Translation
- IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation Metrics for Indian Languages — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- L''évaluation de la traduction automatique du caractère au document : un état de l''art — 2023 · Actes de CORIA-TALN 2023. Actes des 16e Rencontres Jeunes Chercheurs en RI (RJCRI) et 25e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RÉCITAL)
- Large Language Models Are State-of-the-Art Evaluators of Translation Quality — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Leveraging GPT-4 for Automatic Translation Post-Editing — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods — 2023 · arXiv:2309.10966
- MMT's Submission for the WMT 2023 Quality Estimation Shared Task — 2023 · Proceedings of the Eighth Conference on Machine Translation
- MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation — 2023 · Proceedings of the Third Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)
- NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Onception: Active Learning with Expert Advice for Real World Machine Translation — 2023 · Computational Linguistics
- One Embedder, Any Task: Instruction-Finetuned Text Embeddings — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- PE effort and neural-based automatic MT metrics: do they correlate? — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation
- PaLM 2 Technical Report — 2023 · arXiv:2305.10403
- ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Physician Detection of Clinical Harm in Machine Translation: Quality Estimation Aids in Reliance and Backtranslation Identifies Critical Errors — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Prompting PaLM for Translation: Assessing Strategies and Performance — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent — 2023 · Proceedings of the Eighth Conference on Machine Translation
- Rethinking the Word-level Quality Estimation for Machine Translation from Human Judgement — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Reward Gaming in Conditional Text Generation — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic Mistakes — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Student''s t-Distribution: On Measuring the Inter-Rater Reliability When the Observations are Scarce — 2023 · Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
- T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks — 2023 · arXiv:2310.00752
- Team NLLG submission for Eval4NLP 2023 Shared Task: Retrieval-Augmented In-Context Learning for NLG Evaluation — 2023 · Proceedings of the 4th Workshop on Evaluation and Comparison of NLP Systems
- Test-time Adaptation for Machine Translation Evaluation by Uncertainty Minimization — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- The Best of Both Worlds: Combining Human and Machine Translations for Multilingual Semantic Parsing with Active Learning — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation — 2023 · Proceedings of the Eighth Conference on Machine Translation
- The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics — 2023 · Proceedings of the 4th Workshop on Evaluation and Comparison of NLP Systems
- The MT@BZ corpus: machine translation & legal language — 2023 · Proceedings of the 24th Annual Conference of the European Association for Machine Translation