Who cites «BLEURT: Learning Robust Metrics for Text Generation»
- Survey of Hallucination in Natural Language GenerationACM Computing SurveysZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,974 citations
- Gemini: A Family of Highly Capable Multimodal ModelsarXiv:2312.11805Gemini Team, Rohan Anil, Sebastian Borgeaud, et al.2023 · 3,050 citations
- Sparks of Artificial General Intelligence: Early experiments with GPT-4arXiv:2303.12712Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, et al.2023 · 2,439 citations
- TruthfulQA: Measuring How Models Mimic Human FalsehoodsAnnual Meeting of the Association for Computational Linguistics (ACL)Stephanie Lin, Jacob Hilton, Owain Evans2022 · 2,088 citations
- COMET: A Neural Framework for MT EvaluationRicardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 1,792 citations
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,756 citations
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
- PaLM 2 Technical ReportarXiv:2305.10403Rohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 1,000 citations
- BARTScore: Evaluating Generated Text as Text GenerationarXiv:2106.11520Weizhe Yuan, Graham Neubig, Pengfei Liu2021 · 815 citations
- Can Large Language Models Transform Computational Social Science?Computational LinguisticsCaleb Ziems, William Held, Omar Shaikh, et al.2023 · 790 citations
- COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared TaskConference on Machine Translation (WMT)Ricardo Rei, José G. C. de Souza, Duarte Alves, et al.2022 · 435 citations
- Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated FeedbackarXiv:2302.12813Baolin Peng, Michel Galley, Pengcheng He, et al.2023 · 363 citations
- ChatEval: Towards Better LLM-based Evaluators through Multi-Agent DebatearXiv:2308.07201Chi-Min Chan, Weize Chen, Yusheng Su, et al.2023 · 359 citations
- Reformulating Unsupervised Style Transfer as Paraphrase GenerationKalpesh Krishna, John Wieting, Mohit Iyyer2020 · 350 citations
- xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error DetectionTransactions of the Association for Computational Linguistics (TACL)Nuno M. Guerreiro, Ricardo Rei, Daan van Stigt, et al.2024 · 333 citations
- LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative FusionAnnual Meeting of the Association for Computational Linguistics (ACL)Dongfu Jiang, Xiang Ren, Bill Yuchen Lin2023 · 321 citations
- Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Tal Schuster, Adam Fisch, Regina Barzilay2021 · 290 citations
- Is ChatGPT a Good NLG Evaluator? A Preliminary StudyarXiv:2303.04048Jiaan Wang, Yunlong Liang, Fandong Meng, et al.2023 · 287 citations
- AlignScore: Evaluating Factual Consistency with A Unified Alignment FunctionAnnual Meeting of the Association for Computational Linguistics (ACL)Yuheng Zha, Yichi Yang, Ruichen Li, et al.2023 · 284 citations
- Prometheus: Inducing Fine-grained Evaluation Capability in Language ModelsarXiv:2310.08491Seungone Kim, Jamin Shin, Yejin Cho, et al.2023 · 281 citations
- TRUE: Re-evaluating Factual Consistency EvaluationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Or Honovich, Roee Aharoni, Jonathan Herzig, et al.2022 · 279 citations
- Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More RobustMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.2022 · 265 citations
- Automatic Machine Translation Evaluation in Many Languages via Zero-Shot ParaphrasingConference on Empirical Methods in Natural Language Processing (EMNLP)Brian Thompson, Matt Post2020 · 260 citations
- Re-evaluating Evaluation in Text SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP)Manik Bhandari, Pranav Narayan Gour, Atabak Ashfaq, et al.2020 · 259 citations
- MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence FrontiersarXiv:2102.01454Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, et al.2021 · 251 citations
- Hurdles to Progress in Long-form Question AnsweringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kalpesh Krishna, Aurko Roy, Mohit Iyyer2021 · 233 citations
- Detecting Hallucinated Content in Conditional Neural Sequence GenerationFindings of the Association for Computational LinguisticsChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 232 citations
- Tower: An Open Multilingual Large Language Model for Translation-Related TasksarXiv:2402.17733Duarte M. Alves, Jose Pombal, Nuno M. Guerreiro, et al.2024 · 227 citations
- Reinforced Self-Training (ReST) for Language ModelingarXiv:2308.08998Caglar Gulcehre, Tom Le Paine, Srivatsan Srinivasan, et al.2023 · 224 citations
- Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine TranslationarXiv:2401.08417Haoran Xu, Amr Sharaf, Yunmo Chen, et al.2024 · 212 citations
- Explaining Answers with Entailment TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, et al.2021 · 211 citations
- Exploring Human-Like Translation Strategy with Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Zhiwei He, Tian Liang, Wenxiang Jiao, et al.2024 · 207 citations
- IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesarXiv:2305.16307Jay Gala, Pranjal A. Chitale, Raghavan AK, et al.2023 · 200 citations
- Q²: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Or Honovich, Leshem Choshen, Roee Aharoni, et al.2021 · 196 citations
- Results of the WMT20 Metrics Shared TaskConference on Machine Translation (WMT)Nitika Mathur, Johnny Wei, Markus Freitag, et al.2020 · 195 citations
- One Embedder, Any Task: Instruction-Finetuned Text EmbeddingsarXiv:2212.09741Hongjin Su, Weijia Shi, Jungo Kasai, et al.2022 · 194 citations
- Large Language Model UnlearningConference on Neural Information Processing Systems (NeurIPS)Yuanshun Yao, Xiaojun Xu, Yang Liu2023 · 174 citations
- Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy OptimizationarXiv:2210.01241Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kiante Brantley, et al.2022 · 174 citations
- Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-SpecificityarXiv:2310.07521Cunxiang Wang, Xiaoze Liu, Yuanhao Yue, et al.2023 · 171 citations
- Long-form factuality in large language modelsConference on Neural Information Processing Systems (NeurIPS)Jerry Wei, Chengrun Yang, Xinying Song, et al.2024 · 165 citations
- Chart-to-Text: A Large-Scale Benchmark for Chart SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Shankar Kantharaj, Rixie Tiffany Leong, Xiang Lin, et al.2022 · 163 citations
- The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task: Overview and Evaluation Results (WebNLG+ 2020)Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+)Thiago Castro Ferreira, Claire Gardent, Nikolai Ilinykh, et al.2020 · 163 citations
- DART: Open-Domain Structured Data Record to Text GenerationarXiv:2007.02871Linyong Nan, Dragomir Radev, Rui Zhang, et al.2020 · 161 citations
- The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation EvaluationConference on Machine Translation (WMT)Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, et al.2023 · 158 citations
- Understanding tables with intermediate pre-trainingFindings of the Association for Computational LinguisticsJulian Eisenschlos, Syrine Krichene, Thomas Müller2020 · 158 citations
- Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors PersistConference on Machine Translation (WMT)Marzena Karpinska, Mohit Iyyer2023 · 156 citations
- Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not InnocentConference on Machine Translation (WMT)Markus Freitag, Nitika Mathur, Chi-kiu Lo, et al.2023 · 155 citations
- ROSCOE: A Suite of Metrics for Scoring Step-by-Step ReasoningarXiv:2212.07919Olga Golovneva, Moya Chen, Spencer Poff, et al.2022 · 155 citations
- ChatGPT MT: Competitive for High- (but Not Low-) Resource LanguagesConference on Machine Translation (WMT)Nathaniel Robinson, Perez Ogayo, David R. Mortensen, et al.2023 · 153 citations
- FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGNInternational Conference on Spoken Language Translation (IWSLT)Milind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, et al.2023 · 152 citations
- Investigating Pretrained Language Models for Graph-to-Text GenerationWorkshop on Natural Language Processing for Conversational AILeonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, et al.2021 · 151 citations
- Measure and Improve Robustness in NLP Models: A SurveyConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Xuezhi Wang, Haohan Wang, Diyi Yang2022 · 148 citations
- Quality-Aware Decoding for Neural Machine TranslationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Patrick Fernandes, António Farinhas, Ricardo Rei, et al.2022 · 146 citations
- JudgeLM: Fine-tuned Large Language Models are Scalable JudgesarXiv:2310.17631Lianghui Zhu, Xinggang Wang, Xinlong Wang2023 · 145 citations
- GRADE: Automatic Graph-Enhanced Coherence Metric for Evaluating Open-Domain Dialogue SystemsConference on Empirical Methods in Natural Language Processing (EMNLP)Lishan Huang, Zheng Ye, Jinghui Qin, et al.2020 · 144 citations
- Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse ModelsarXiv:2404.18796Pat Verga, Sebastian Hofstatter, Sophia Althammer, et al.2024 · 138 citations
- Attributed Question Answering: Evaluation and Modeling for Attributed Large Language ModelsarXiv:2212.08037Bernd Bohnet, Vinh Q. Tran, Pat Verga, et al.2022 · 138 citations
- Investigating Data Contamination in Modern Benchmarks for Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chunyuan Deng, Yilun Zhao, Xiangru Tang, et al.2024 · 137 citations
- Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language ModelsFindings of the Association for Computational LinguisticsQingyu Lu, Baopu Qiu, Liang Ding, et al.2024 · 136 citations
- FLUTE: Figurative Language Understanding through Textual ExplanationsConference on Empirical Methods in Natural Language Processing (EMNLP)Tuhin Chakrabarty, Arkadiy Saakyan, Debanjan Ghosh, et al.2022 · 133 citations
- GO FIGURE: A Meta Evaluation of Factuality in SummarizationFindings of the Association for Computational LinguisticsSaadia Gabriel, Asli Celikyilmaz, Rahul Jha, et al.2021 · 130 citations
- Learning Compact Metrics for MTConference on Empirical Methods in Natural Language Processing (EMNLP)Amy Pu, Hyung Won Chung, Ankur Parikh, et al.2021 · 130 citations
- Time Travel in LLMs: Tracing Data Contamination in Large Language ModelsarXiv:2308.08493Shahriar Golchin, Mihai Surdeanu2023 · 128 citations
- A Comprehensive Assessment of Dialog Evaluation MetricsThe First Workshop on Evaluations and Assessments of Neural Conversation SystemsYi-Ting Yeh, Maxine Eskenazi, Shikib Mehri2021 · 128 citations
- INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic FeedbackConference on Empirical Methods in Natural Language Processing (EMNLP)Wenda Xu, Danqing Wang, Liangming Pan, et al.2023 · 123 citations
- High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural MetricsTransactions of the Association for Computational Linguistics (TACL)Markus Freitag, David Grangier, Qijun Tan, et al.2022 · 121 citations
- MetricX-24: The Google Submission to the WMT 2024 Metrics Shared TaskConference on Machine Translation (WMT)Juraj Juraska, Daniel Deutsch, Mara Finkelstein, et al.2024 · 118 citations
- MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskConference on Machine Translation (WMT)Juraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.2023 · 118 citations
- A Critical Evaluation of Evaluations for Long-form Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Fangyuan Xu, Yixiao Song, Mohit Iyyer, et al.2023 · 117 citations
- LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form SummarizationConference of the European Chapter of the Association for Computational Linguistics (EACL)Kalpesh Krishna, Erin Bransom, Bailey Kuehl, et al.2023 · 114 citations
- Benchmarking Machine Translation with Cultural AwarenessarXiv:2305.14328Binwei Yao, Ming Jiang, Tara Bobinac, et al.2023 · 110 citations
- LENS: A Learnable Evaluation Metric for Text SimplificationAnnual Meeting of the Association for Computational Linguistics (ACL)Mounica Maddela, Yao Dou, David Heineman, et al.2023 · 104 citations
- Investigating Reasons for Disagreement in Natural Language InferenceTransactions of the Association for Computational Linguistics (TACL)Nan-Jiang Jiang, Marie-Catherine de Marneffe2022 · 104 citations
- Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Mingkai Deng, Bowen Tan, Zhengzhong Liu, et al.2021 · 102 citations
- Evaluating Attribution in Dialogue Systems: The BEGIN BenchmarkTransactions of the Association for Computational Linguistics (TACL)Nouha Dziri, Hannah Rashkin, Tal Linzen, et al.2022 · 100 citations
- Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Jannis Bulian, Christian Buck, Wojciech Gajewski, et al.2022 · 100 citations
- UniTE: Unified Translation EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Wan, Dayiheng Liu, Baosong Yang, et al.2022 · 100 citations
- Unbabel's Participation in the WMT20 Metrics Shared TaskConference on Machine Translation (WMT)Ricardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 98 citations
- f-Divergence Minimization for Sequence-Level Knowledge DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Yuqiao Wen, Zichao Li, Wenyu Du, et al.2023 · 92 citations
- Large Language Models are Inconsistent and Biased EvaluatorsarXiv:2405.01724Rickard Stureborg, Dimitris Alikaniotis, Yoshi Suhara2024 · 91 citations
- RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model OutputsAnnual Meeting of the Association for Computational Linguistics (ACL)Afra Feyza Akyurek, Ekin Akyurek, Ashwin Kalyan, et al.2023 · 89 citations
- Pride and Prejudice: LLM Amplifies Self-Bias in Self-RefinementAnnual Meeting of the Association for Computational Linguistics (ACL)Wenda Xu, Guanglei Zhu, Xuandong Zhao, et al.2024 · 88 citations
- Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
- Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language GenerationTransactions of the Association for Computational Linguistics (TACL)Patrick Fernandes, Aman Madaan, Emmy Liu, et al.2023 · 84 citations
- Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared TaskConference on Machine Translation (WMT)Ricardo Rei, Ana C Farinha, Chrysoula Zerva, et al.2021 · 84 citations
- On Decoding Strategies for Neural Text GeneratorsTransactions of the Association for Computational Linguistics (TACL)Gian Wiher, Clara Meister, Ryan Cotterell2022 · 81 citations
- Findings of the WMT 2021 Shared Task on Quality EstimationConference on Machine Translation (WMT)Lucia Specia, Frédéric Blain, Marina Fomicheva, et al.2021 · 80 citations
- Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie CalibrationConference on Empirical Methods in Natural Language Processing (EMNLP)Daniel Deutsch, George Foster, Markus Freitag2023 · 76 citations
- Benchmarking Large Language Models on Answering and Explaining Challenging Medical QuestionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Hanjie Chen, Zhouxiang Fang, Yash Singla, et al.2025 · 75 citations
- ReCEval: Evaluating Reasoning Chains via Correctness and InformativenessConference on Empirical Methods in Natural Language Processing (EMNLP)Archiki Prasad, Swarnadeep Saha, Xiang Zhou, et al.2023 · 73 citations
- Towards Safer Large Language Models through Machine UnlearningFindings of the Association for Computational LinguisticsZheyuan Liu, Guangyao Dou, Zhaoxuan Tan, et al.2024 · 72 citations
- Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level MetricConference on Machine Translation (WMT)Giorgos Vernikos, Brian Thompson, Prashant Mathur, et al.2022 · 68 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
- Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared TaskConference on Machine Translation (WMT)Thibault Sellam, Amy Pu, Hyung Won Chung, et al.2020 · 55 citations
- DiscoScore: Evaluating Text Generation with BERT and Discourse CoherenceConference of the European Chapter of the Association for Computational Linguistics (EACL)Wei Zhao, Michael Strube, Steffen Eger2023 · 53 citations
- TellMeWhy: A Dataset for Answering Why-Questions in NarrativesYash Kumar Lal, Nathanael Chambers, Raymond Mooney, et al.2021 · 53 citations
- FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Andrew Zhu, Alyssa Hwang, Liam Dugan, et al.2024 · 51 citations
- Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMRJuri Opitz, Anette Frank2021 · 51 citations
- TIGERScore: Towards Building Explainable Metric for All Text Generation TasksarXiv:2310.00752Dongfu Jiang, Yishan Li, Ge Zhang, et al.2023 · 50 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/sellam-2020-bleurt-learning-robust-metrics-text/cited-by/