Who cites Huaxiu Yao
- Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation ExtractorsFindings of the Association for Computational LinguisticsKai Zhang, Bernal Jimenez Gutierrez, Yu Su2023 · 118 citations
- Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human EvaluationarXiv:2212.07981Yixin Liu, Alexander R. Fabbri, Pengfei Liu, et al.2022 · 117 citations
- LMMs-Eval: Reality Check on the Evaluation of Large Multimodal ModelsFindings of the Association for Computational LinguisticsKaichen Zhang, Bo Li, Peiyuan Zhang, et al.2025 · 115 citations
- RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text DetectorsAnnual Meeting of the Association for Computational Linguistics (ACL)Liam Dugan, Alyssa Hwang, Filip Trhlík, et al.2024 · 110 citations
- Leveraging GPT-4 for Automatic Translation Post-EditingFindings of the Association for Computational LinguisticsVikas Raunak, Amr Sharaf, Yiren Wang, et al.2023 · 108 citations
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
- Disentangling Length from Quality in Direct Preference OptimizationFindings of the Association for Computational LinguisticsRyan Park, Rafael Rafailov, Stefano Ermon, et al.2024 · 105 citations
- Inverse Scaling: When Bigger Isn't BetterarXiv:2306.09479 · Transactions on Machine Learning Research (TMLR), 10/2023, https://openreview.net/forum?id=DwgRm72GQFIan R. McKenzie, Alexander Lyzhov, Michael Pieler, et al.2023 · 105 citations
- MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 103 citations
- BLOOM+1: Adding Language Support to BLOOM for Zero-Shot PromptingAnnual Meeting of the Association for Computational Linguistics (ACL)Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, et al.2023 · 102 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- On Learning to Summarize with Large Language Models as ReferencesConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yixin Liu, Kejian Shi, Katherine He, et al.2024 · 94 citations
- Do-Not-Answer: Evaluating Safeguards in LLMsFindings of the Association for Computational LinguisticsYuxia Wang, Haonan Li, Xudong Han, et al.2024 · 93 citations
- LLMs Are Few-Shot In-Context Low-Resource Language LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Samuel Cahyawijaya, Holy Lovenia, Pascale Fung2024 · 93 citations
- WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
- On the Tool Manipulation Capability of Open-source Large Language ModelsarXiv:2305.16504Qiantong Xu, Fenglu Hong, Bo Li, et al.2023 · 92 citations
- “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language ModelsFindings of the Association for Computational LinguisticsXinpeng Wang, Bolei Ma, Chengzhi Hu, et al.2024 · 91 citations
- Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence TasksConference on Empirical Methods in Natural Language Processing (EMNLP)Andrea Sottana, Bin Liang, Kai Zou, et al.2023 · 89 citations
- Machine Unlearning of Pre-trained Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jin Yao, Eli Chien, Minxin Du, et al.2024 · 86 citations
- SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural ReasoningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Zhengyuan Liu, Xin Huang, et al.2024 · 85 citations
- Detoxifying Large Language Models via Knowledge EditingAnnual Meeting of the Association for Computational Linguistics (ACL)Mengru Wang, Ningyu Zhang, Ziwen Xu, et al.2024 · 84 citations
- Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD ExamplesConference on Neural Information Processing Systems (NeurIPS)Abulhair Saparov, Richard Yuanzhe Pang, Vishakh Padmakumar, et al.2023 · 84 citations
- Mitigating the Alignment Tax of RLHFConference on Empirical Methods in Natural Language Processing (EMNLP)Yong Lin, Hangyu Lin, Wei Xiong, et al.2024 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- KoBBQ: Korean Bias Benchmark for Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Jiho Jin, Jiseon Kim, Nayeon Lee, et al.2024 · 78 citations
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMsarXiv:2308.13387Yuxia Wang, Haonan Li, Xudong Han, et al.2023 · 78 citations
- Factuality of Large Language Models: A SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxia Wang, Minghan Wang, Muhammad Arslan Manzoor, et al.2024 · 77 citations
- OR-Bench: An Over-Refusal Benchmark for Large Language ModelsarXiv:2405.20947Justin Cui, Wei-Lin Chiang, Ion Stoica, et al.2024 · 76 citations
- MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical ReasoningConference on Neural Information Processing Systems (NeurIPS)Shuyue Stella Li, Vidhisha Balachandran, Shangbin Feng, et al.2024 · 74 citations
- MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, et al.2024 · 74 citations
- AlignBench: Benchmarking Chinese Alignment of Large Language ModelsarXiv:2311.18743Xiao Liu, Xuanyu Lei, Shengyuan Wang, et al.2023 · 74 citations
- Quantifying Uncertainty in Answers from any Language Model and Enhancing their TrustworthinessAnnual Meeting of the Association for Computational Linguistics (ACL)Jiuhai Chen, Jonas Mueller2024 · 72 citations
- Towards Safer Large Language Models through Machine UnlearningFindings of the Association for Computational LinguisticsZheyuan Liu, Guangyao Dou, Zhaoxuan Tan, et al.2024 · 72 citations
- Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning PerformancearXiv:2305.17306Yao Fu, Litu Ou, Mingyu Chen, et al.2023 · 72 citations
- Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoying Zhang, Baolin Peng, Ye Tian, et al.2024 · 69 citations
- Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective RewardsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxiang Wang, Yong Lin, Wei Xiong, et al.2024 · 68 citations
- Phoenix: Democratizing ChatGPT across LanguagesarXiv:2304.10453Zhihong Chen, Feng Jiang, Junying Chen, et al.2023 · 68 citations
- ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidenceConference on Neural Information Processing Systems (NeurIPS)Kevin Wu, Eric Wu, James Zou2024 · 65 citations
- Evaluation of OpenAI o1: Opportunities and Challenges of AGIarXiv:2409.18486Tianyang Zhong, Zhengliang Liu, Yi Pan, et al.2024 · 64 citations
- CValues: Measuring the Values of Chinese Large Language Models from Safety to ResponsibilityarXiv:2307.09705Guohai Xu, Jiayi Liu, Ming Yan, et al.2023 · 64 citations
- What Did I Do Wrong? Quantifying LLMs' Sensitivity and Consistency to Prompt EngineeringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Federico Errica, Davide Sanvito, Giuseppe Siracusano, et al.2025 · 63 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Revolutionizing Finance with LLMs: An Overview of Applications and InsightsarXiv:2401.11641Huaqin Zhao, Zhengliang Liu, Zihao Wu, et al.2024 · 63 citations
- Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
- Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
- MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language BenchmarkarXiv:2402.04788Dongping Chen, Ruoxi Chen, Shilin Zhang, et al.2024 · 60 citations
- Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Yongqi Tong, Dawei Li, Sizhe Wang, et al.2024 · 57 citations
- Dialect prejudice predicts AI decisions about people's character, employability, and criminalityarXiv:2403.00742Valentin Hofmann, Pratyusha Ria Kalluri, Dan Jurafsky, et al.2024 · 57 citations
- SuperCLUE: A Comprehensive Chinese Large Language Model BenchmarkarXiv:2307.15020Liang Xu, Anqi Li, Lei Zhu, et al.2023 · 57 citations
- The Art of Saying No: Contextual Noncompliance in Language ModelsConference on Neural Information Processing Systems (NeurIPS)Faeze Brahman, Sachin Kumar, Vidhisha Balachandran, et al.2024 · 56 citations
- A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
- Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?Annual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Abhilasha Ravichander, Rachel Rudinger2024 · 52 citations
- On the application of Large Language Models for language teaching and assessment technologyarXiv:2307.08393Andrew Caines, Luca Benedetto, Shiva Taslimipoor, et al.2023 · 51 citations
- Unfamiliar Finetuning Examples Control How Language Models HallucinateConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Katie Kang, Eric Wallace, Claire Tomlin, et al.2025 · 47 citations
- Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?Language Resources and Evaluation Conference (LREC)Wangyue Li, Liangzhi Li, Tong Xiang, et al.2024 · 47 citations
- Metaphor Understanding Challenge Dataset for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Tong, Rochelle Choenni, Martha Lewis, et al.2024 · 47 citations
- NormAd: A Framework for Measuring the Cultural Adaptability of Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Abhinav Rao, Akhila Yerukola, Vishwa Shah, et al.2025 · 46 citations
- SOUL: Unlocking the Power of Second-Order Optimization for LLM UnlearningConference on Empirical Methods in Natural Language Processing (EMNLP)Jinghan Jia, Yihua Zhang, Yimeng Zhang, et al.2024 · 46 citations
- GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local RefinementsarXiv:2402.10963Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, et al.2024 · 45 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
- When does In-context Learning Fall Short and Why? A Study on Specification-Heavy TasksarXiv:2311.08993Hao Peng, Xiaozhi Wang, Jianhui Chen, et al.2023 · 42 citations
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow InstructionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Orion Weller, Benjamin Chang, Sean MacAvaney, et al.2025 · 40 citations
- Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?Conference on Empirical Methods in Natural Language Processing (EMNLP)Gal Yona, Roee Aharoni, Mor Geva2024 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- Sociodemographic Bias in Language Models: A Survey and Forward PathWorkshop on Gender Bias in Natural Language ProcessingVipul Gupta, Pranav Narayanan Venkit, Shomir Wilson, et al.2023 · 40 citations
- Introducing v0.5 of the AI Safety Benchmark from MLCommonsarXiv:2404.12241Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, et al.2024 · 38 citations
- An Emulator for Fine-Tuning Large Language Models using Small Language ModelsarXiv:2310.12962Eric Mitchell, Rafael Rafailov, Archit Sharma, et al.2023 · 36 citations
- Benchmarking Distributional Alignment of Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Nicole Meister, Carlos Guestrin, Tatsunori Hashimoto2025 · 35 citations
- Through the Lens of Core Competency: Survey on Evaluation of Large Language ModelsarXiv:2308.07902Ziyu Zhuang, Qiguang Chen, Longxuan Ma, et al.2023 · 35 citations
- Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge EvaluationarXiv:2306.05783Zhouhong Gu, Xiaoxuan Zhu, Haoning Ye, et al.2023 · 34 citations
- SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model SafetyarXiv:2404.05399Paul Rottger, Fabio Pernisi, Bertie Vidgen, et al.2024 · 33 citations
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsarXiv:2309.06085Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, et al.2023 · 33 citations
- Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM EvaluationInternational Conference on Computational Linguistics (COLING)Siyuan Wang, Zhuohan Long, Zhihao Fan, et al.2025 · 30 citations
- Knowledge Boundary of Large Language Models: A SurveyAnnual Meeting of the Association for Computational Linguistics (ACL)Moxin Li, Yong Zhao, Wenxuan Zhang, et al.2025 · 30 citations
- Contextualization Distillation from Large Language Model for Knowledge Graph CompletionFindings of the Association for Computational LinguisticsDawei Li, Zhen Tan, Tianlong Chen, et al.2024 · 30 citations
- Jamba-1.5: Hybrid Transformer-Mamba Models at ScalearXiv:2408.12570Jamba Team: Barak Lenz, Alan Arazi, Amir Bergman, et al.2024 · 30 citations
- Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language ModelsarXiv:2403.14859Carina Kauf, Emmanuele Chersoni, Alessandro Lenci, et al.2024 · 29 citations
- Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningConference on Computational Natural Language Learning (CoNLL)Lucas Weber, Elia Bruni, Dieuwke Hupkes2023 · 29 citations
- Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
- SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check ConsistencyarXiv:2311.01740Jiaxin Zhang, Zhuohang Li, Kamalika Das, et al.2023 · 28 citations
- L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Ansong Ni, Pengcheng Yin, Yilun Zhao, et al.2024 · 27 citations
- Prediction of Arabic Legal Rulings using Large Language ModelsElectronicsAdel Ammar, Anis Koubaa, Bilel Benjdira, et al.2023 · 27 citations
- Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and EvaluationACM Computing SurveysSteffen Eger, Yong Cao, Jennifer D'Souza, et al.2025 · 25 citations
- VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement LearningConference on Neural Information Processing Systems (NeurIPS)Qiuchen Wang, Ruixue Ding, Yu Zeng, et al.2025 · 23 citations
- LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and DistillationarXiv:2401.17244Yuan Chiang, Elvis Hsieh, Chia-Hong Chou, et al.2024 · 23 citations
- What is the Role of Small Models in the LLM Era: A SurveyComputational LinguisticsLihu Chen, Gael Varoquaux2024 · 23 citations
- COLLIE: Systematic Construction of Constrained Text Generation TasksarXiv:2307.08689Shunyu Yao, Howard Chen, Austin W. Hanjie, et al.2023 · 23 citations
- Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language ModelsInternational Conference on Computational Linguistics (COLING)Nishanth Madhusudhan, Sathwik Tejaswi Madhusudhan, Vikas Yadav, et al.2025 · 22 citations
- Cracking the Code of Hallucination in LVLMs with Vision-aware Head DivergenceAnnual Meeting of the Association for Computational Linguistics (ACL)Jinghan He, Kuan Zhu, Haiyun Guo, et al.2025 · 21 citations
- LongReward: Improving Long-context Large Language Models with AI FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL)Jiajie Zhang, Zhongni Hou, Xin Lv, et al.2025 · 21 citations
- DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic RulesYanchen Liu, William Held, Diyi Yang2023 · 20 citations
- Can Unconfident LLM Annotations Be Used for Confident Conclusions?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kristina Gligorić, Tijana Zrnic, Cinoo Lee, et al.2025 · 19 citations
- Shaping the Safety Boundaries: Understanding and Defending Against Jailbreaks in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Lang Gao, Jiahui Geng, Xiangliang Zhang, et al.2025 · 19 citations
- Timo: Towards Better Temporal Reasoning for Language ModelsarXiv:2406.14192Zhaochen Su, Jun Zhang, Tong Zhu, et al.2024 · 19 citations
- ReasonRank: Empowering Passage Ranking with Strong Reasoning AbilityAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhan Liu, Xinyu Ma, Weiwei Sun, et al.2026 · 18 citations
- Do Large Language Models Understand Word Senses?Domenico Meconi, Simone Stirpe, Federico Martelli2025 · 18 citations
- Elaborative Simplification as Implicit Questions Under DiscussionYating Wu, William Sheffield, Kyle Mahowald, et al.2023 · 18 citations
- DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning GraphConference on Neural Information Processing Systems (NeurIPS)Zhehao Zhang, Jiaao Chen, Diyi Yang2024 · 17 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/huaxiu-yao/cited-by/page/2/