Who cites Yuta Koreeda
- Unlimiformer: Long-Range Transformers with Unlimited Length InputConference on Neural Information Processing Systems (NeurIPS)Amanda Bertsch, Uri Alon, Graham Neubig, et al.2023 · 111 citations
- RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text DetectorsAnnual Meeting of the Association for Computational Linguistics (ACL)Liam Dugan, Alyssa Hwang, Filip Trhlík, et al.2024 · 110 citations
- INSIDE: LLMs' Internal States Retain the Power of Hallucination DetectionarXiv:2402.03744Chao Chen, Kai Liu, Ze Chen, et al.2024 · 108 citations
- Leveraging GPT-4 for Automatic Translation Post-EditingFindings of the Association for Computational LinguisticsVikas Raunak, Amr Sharaf, Yiren Wang, et al.2023 · 108 citations
- Benchmarking Foundation Models with Language-Model-as-an-ExaminerConference on Neural Information Processing Systems (NeurIPS)Yushi Bai, Jiahao Ying, Yixin Cao, et al.2023 · 106 citations
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
- Disentangling Length from Quality in Direct Preference OptimizationFindings of the Association for Computational LinguisticsRyan Park, Rafael Rafailov, Stefano Ermon, et al.2024 · 105 citations
- Inverse Scaling: When Bigger Isn't BetterarXiv:2306.09479 · Transactions on Machine Learning Research (TMLR), 10/2023, https://openreview.net/forum?id=DwgRm72GQFIan R. McKenzie, Alexander Lyzhov, Michael Pieler, et al.2023 · 105 citations
- Model evaluation for extreme risksarXiv:2305.15324Toby Shevlane, Sebastian Farquhar, Ben Garfinkel, et al.2023 · 104 citations
- MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 103 citations
- BLOOM+1: Adding Language Support to BLOOM for Zero-Shot PromptingAnnual Meeting of the Association for Computational Linguistics (ACL)Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, et al.2023 · 102 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- FELM: Benchmarking Factuality Evaluation of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shiqi Chen, Yiran Zhao, Jinghan Zhang, et al.2023 · 99 citations
- A Survey of Confidence Estimation and Calibration in Large Language ModelsarXiv:2311.08298Jiahui Geng, Fengyu Cai, Yuxia Wang, et al.2023 · 97 citations
- On Learning to Summarize with Large Language Models as ReferencesConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yixin Liu, Kejian Shi, Katherine He, et al.2024 · 94 citations
- Efficient Long-Text Understanding with Short-Text ModelsTransactions of the Association for Computational Linguistics (TACL)Maor Ivgi, Uri Shaham, Jonathan Berant2023 · 94 citations
- Do-Not-Answer: Evaluating Safeguards in LLMsFindings of the Association for Computational LinguisticsYuxia Wang, Haonan Li, Xudong Han, et al.2024 · 93 citations
- LLMs Are Few-Shot In-Context Low-Resource Language LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Samuel Cahyawijaya, Holy Lovenia, Pascale Fung2024 · 93 citations
- On the Tool Manipulation Capability of Open-source Large Language ModelsarXiv:2305.16504Qiantong Xu, Fenglu Hong, Bo Li, et al.2023 · 92 citations
- “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language ModelsFindings of the Association for Computational LinguisticsXinpeng Wang, Bolei Ma, Chengzhi Hu, et al.2024 · 91 citations
- SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific ResearchProceedings of the AAAI Conference on Artificial IntelligenceLiangtai Sun, Yang Han, Zihan Zhao, et al.2023 · 91 citations
- AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
- Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence TasksConference on Empirical Methods in Natural Language Processing (EMNLP)Andrea Sottana, Bin Liang, Kai Zou, et al.2023 · 89 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Machine Unlearning of Pre-trained Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jin Yao, Eli Chien, Minxin Du, et al.2024 · 86 citations
- SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural ReasoningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Zhengyuan Liu, Xin Huang, et al.2024 · 85 citations
- CoLT5: Faster Long-Range Transformers with Conditional ComputationConference on Empirical Methods in Natural Language Processing (EMNLP)Joshua Ainslie, Tao Lei, Michiel de Jong, et al.2023 · 84 citations
- Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD ExamplesConference on Neural Information Processing Systems (NeurIPS)Abulhair Saparov, Richard Yuanzhe Pang, Vishakh Padmakumar, et al.2023 · 84 citations
- LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model DevelopmentAnnual Meeting of the Association for Computational Linguistics (ACL)Ilias Chalkidis, Nicolas Garneau, Catalina Goanta, et al.2023 · 83 citations
- PRD: Peer Rank and Discussion Improve Large Language Model based EvaluationsarXiv:2307.02762Ruosen Li, Teerth Patel, Xinya Du2023 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- Does Writing with Language Models Reduce Content Diversity?arXiv:2309.05196Vishakh Padmakumar, He He2023 · 82 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- KoBBQ: Korean Bias Benchmark for Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Jiho Jin, Jiseon Kim, Nayeon Lee, et al.2024 · 78 citations
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMsarXiv:2308.13387Yuxia Wang, Haonan Li, Xudong Han, et al.2023 · 78 citations
- MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, et al.2024 · 74 citations
- When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model LeaderboardsarXiv:2402.01781Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, et al.2024 · 74 citations
- AlignBench: Benchmarking Chinese Alignment of Large Language ModelsarXiv:2311.18743Xiao Liu, Xuanyu Lei, Shengyuan Wang, et al.2023 · 74 citations
- Large Language Models as Analogical ReasonersarXiv:2310.01714Michihiro Yasunaga, Xinyun Chen, Yujia Li, et al.2023 · 74 citations
- Benchmarking Benchmark Leakage in Large Language ModelsarXiv:2404.18824Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.2024 · 73 citations
- Towards Safer Large Language Models through Machine UnlearningFindings of the Association for Computational LinguisticsZheyuan Liu, Guangyao Dou, Zhaoxuan Tan, et al.2024 · 72 citations
- Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning PerformancearXiv:2305.17306Yao Fu, Litu Ou, Mingyu Chen, et al.2023 · 72 citations
- Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective RewardsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxiang Wang, Yong Lin, Wei Xiong, et al.2024 · 68 citations
- Branch-Solve-Merge Improves Large Language Model Evaluation and GenerationarXiv:2310.15123Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, et al.2023 · 68 citations
- Phoenix: Democratizing ChatGPT across LanguagesarXiv:2304.10453Zhihong Chen, Feng Jiang, Junying Chen, et al.2023 · 68 citations
- ARB: Advanced Reasoning Benchmark for Large Language ModelsarXiv:2307.13692Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, et al.2023 · 66 citations
- Evaluation of OpenAI o1: Opportunities and Challenges of AGIarXiv:2409.18486Tianyang Zhong, Zhengliang Liu, Yi Pan, et al.2024 · 64 citations
- CValues: Measuring the Values of Chinese Large Language Models from Safety to ResponsibilityarXiv:2307.09705Guohai Xu, Jiayi Liu, Ming Yan, et al.2023 · 64 citations
- What Did I Do Wrong? Quantifying LLMs' Sensitivity and Consistency to Prompt EngineeringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Federico Errica, Davide Sanvito, Giuseppe Siracusano, et al.2025 · 63 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
- LAB-Bench: Measuring Capabilities of Language Models for Biology ResearcharXiv:2407.10362Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, et al.2024 · 62 citations
- Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
- SatLM: Satisfiability-Aided Language Models Using Declarative PromptingConference on Neural Information Processing Systems (NeurIPS)Xi Ye, Qiaochu Chen, Isil Dillig, et al.2023 · 62 citations
- Teaching Large Language Models to Reason with Reinforcement LearningarXiv:2403.04642Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, et al.2024 · 61 citations
- Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Yongqi Tong, Dawei Li, Sizhe Wang, et al.2024 · 57 citations
- Dialect prejudice predicts AI decisions about people's character, employability, and criminalityarXiv:2403.00742Valentin Hofmann, Pratyusha Ria Kalluri, Dan Jurafsky, et al.2024 · 57 citations
- SuperCLUE: A Comprehensive Chinese Large Language Model BenchmarkarXiv:2307.15020Liang Xu, Anqi Li, Lei Zhu, et al.2023 · 57 citations
- Parsel: Algorithmic Reasoning with Language Models by Composing DecompositionsConference on Neural Information Processing Systems (NeurIPS)Eric Zelikman, Qian Huang, Gabriel Poesia, et al.2023 · 56 citations
- AI Agents That MatterarXiv:2407.01502Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, et al.2024 · 55 citations
- Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?Annual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Abhilasha Ravichander, Rachel Rudinger2024 · 52 citations
- On the application of Large Language Models for language teaching and assessment technologyarXiv:2307.08393Andrew Caines, Luca Benedetto, Shiva Taslimipoor, et al.2023 · 51 citations
- Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?Language Resources and Evaluation Conference (LREC)Wangyue Li, Liangzhi Li, Tong Xiang, et al.2024 · 47 citations
- Metaphor Understanding Challenge Dataset for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Tong, Rochelle Choenni, Martha Lewis, et al.2024 · 47 citations
- GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local RefinementsarXiv:2402.10963Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, et al.2024 · 45 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
- When does In-context Learning Fall Short and Why? A Study on Specification-Heavy TasksarXiv:2311.08993Hao Peng, Xiaozhi Wang, Jianhui Chen, et al.2023 · 42 citations
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow InstructionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Orion Weller, Benjamin Chang, Sean MacAvaney, et al.2025 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- Sociodemographic Bias in Language Models: A Survey and Forward PathWorkshop on Gender Bias in Natural Language ProcessingVipul Gupta, Pranav Narayanan Venkit, Shomir Wilson, et al.2023 · 40 citations
- Introducing v0.5 of the AI Safety Benchmark from MLCommonsarXiv:2404.12241Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, et al.2024 · 38 citations
- Through the Lens of Core Competency: Survey on Evaluation of Large Language ModelsarXiv:2308.07902Ziyu Zhuang, Qiguang Chen, Longxuan Ma, et al.2023 · 35 citations
- Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge EvaluationarXiv:2306.05783Zhouhong Gu, Xiaoxuan Zhu, Haoning Ye, et al.2023 · 34 citations
- SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model SafetyarXiv:2404.05399Paul Rottger, Fabio Pernisi, Bertie Vidgen, et al.2024 · 33 citations
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsarXiv:2309.06085Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, et al.2023 · 33 citations
- Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM EvaluationInternational Conference on Computational Linguistics (COLING)Siyuan Wang, Zhuohan Long, Zhihao Fan, et al.2025 · 30 citations
- Contextualization Distillation from Large Language Model for Knowledge Graph CompletionFindings of the Association for Computational LinguisticsDawei Li, Zhen Tan, Tianlong Chen, et al.2024 · 30 citations
- Jamba-1.5: Hybrid Transformer-Mamba Models at ScalearXiv:2408.12570Jamba Team: Barak Lenz, Alan Arazi, Amir Bergman, et al.2024 · 30 citations
- Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningConference on Computational Natural Language Learning (CoNLL)Lucas Weber, Elia Bruni, Dieuwke Hupkes2023 · 29 citations
- Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
- L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Ansong Ni, Pengcheng Yin, Yilun Zhao, et al.2024 · 27 citations
- Prediction of Arabic Legal Rulings using Large Language ModelsElectronicsAdel Ammar, Anis Koubaa, Bilel Benjdira, et al.2023 · 27 citations
- LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and DistillationarXiv:2401.17244Yuan Chiang, Elvis Hsieh, Chia-Hong Chou, et al.2024 · 23 citations
- COLLIE: Systematic Construction of Constrained Text Generation TasksarXiv:2307.08689Shunyu Yao, Howard Chen, Austin W. Hanjie, et al.2023 · 23 citations
- DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic RulesYanchen Liu, William Held, Diyi Yang2023 · 20 citations
- ReasonRank: Empowering Passage Ranking with Strong Reasoning AbilityAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhan Liu, Xinyu Ma, Weiwei Sun, et al.2026 · 18 citations
- Do Large Language Models Understand Word Senses?Domenico Meconi, Simone Stirpe, Federico Martelli2025 · 18 citations
- Elaborative Simplification as Implicit Questions Under DiscussionYating Wu, William Sheffield, Kyle Mahowald, et al.2023 · 18 citations
- DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning GraphConference on Neural Information Processing Systems (NeurIPS)Zhehao Zhang, Jiaao Chen, Diyi Yang2024 · 17 citations
- MultiPragEval: Multilingual Pragmatic Evaluation of Large Language ModelsProceedings of the 2nd GenBench Workshop on Generalisation (Benchmarking) in NLPDojun Park, Jiwoo Lee, Seohyun Park, et al.2024 · 17 citations
- Evaluating the Consistency of LLM EvaluatorsInternational Conference on Computational Linguistics (COLING)Noah Lee, Jiwoo Hong, James Thorne2025 · 16 citations
- Towards Data Contamination Detection for Modern Large Language Models: Limitations, Inconsistencies, and Oracle ChallengesInternational Conference on Computational Linguistics (COLING)Vinay Samuel, Yue Zhou, Henry Peng Zou2025 · 16 citations
- Translation in the Hands of Many: Centering Lay Users in Machine Translation InteractionsConference on Empirical Methods in Natural Language Processing (EMNLP)Beatrice Savoldi, Alan Ramponi, Matteo Negri, et al.2025 · 16 citations
- LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in EnglishNatural Legal Language Processing WorkshopSantosh T.Y.S.S, Cornelius Weiss, Matthias Grabmair2024 · 16 citations
- When One LLM Drools, Multi-LLM Collaboration RulesAnnual Meeting of the Association for Computational Linguistics (ACL)Shangbin Feng, Wenxuan Ding, Alisa Liu, et al.2026 · 14 citations
- BALSAM: A Platform for Benchmarking Arabic Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Rawan Al-Matham, Kareem Darwish, Raghad Al-Rasheed, et al.2025 · 14 citations
- CoMAT: Chain of Mathematically Annotated Thought Improves Mathematical ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Joshua Ong Jun Leang, Aryo Pradipta Gema, Shay B. Cohen2025 · 14 citations
- Mind the Blind Spots: A Focus-Level Evaluation Framework for LLM ReviewsConference on Empirical Methods in Natural Language Processing (EMNLP)Hyungyu Shin, Jingyu Tang, Yoonjoo Lee, et al.2025 · 14 citations
- Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of ArabicArabic Natural Language Processing Conference (ArabicNLP)Sabri Boughorbel, Majd Hawasly2023 · 14 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yuta-koreeda/cited-by/page/2/