Who cites Qian Huang
- H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language ModelsarXiv:2306.14048Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.2023 · 124 citations
- Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
- Unlearn What You Want to Forget: Efficient Unlearning for LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Jiaao Chen, Diyi Yang2023 · 124 citations
- LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal DomainFindings of the Association for Computational LinguisticsJoel Niklaus, Veton Matoshi, Pooja Rani, et al.2023 · 123 citations
- Quiet-STaR: Language models can teach themselves to think before speaking2024 · 122 citations
- Llumnix: Dynamic Scheduling for Large Language Model ServingOSDI 2024Biao Sun, Ziming Huang, Hanyu Zhao, et al.2024 · 119 citations
- Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation ExtractorsFindings of the Association for Computational LinguisticsKai Zhang, Bernal Jimenez Gutierrez, Yu Su2023 · 118 citations
- Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human EvaluationarXiv:2212.07981Yixin Liu, Alexander R. Fabbri, Pengfei Liu, et al.2022 · 117 citations
- Med-Flamingo: a Multimodal Medical Few-shot LearnerarXiv:2307.15189Michael Moor, Qian Huang, Shirley Wu, et al.2023 · 116 citations
- LMMs-Eval: Reality Check on the Evaluation of Large Multimodal ModelsFindings of the Association for Computational LinguisticsKaichen Zhang, Bo Li, Peiyuan Zhang, et al.2025 · 115 citations
- ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language ModelsarXiv:2404.07738Jinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, et al.2024 · 111 citations
- RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text DetectorsAnnual Meeting of the Association for Computational Linguistics (ACL)Liam Dugan, Alyssa Hwang, Filip Trhlík, et al.2024 · 110 citations
- INSIDE: LLMs' Internal States Retain the Power of Hallucination DetectionarXiv:2402.03744Chao Chen, Kai Liu, Ze Chen, et al.2024 · 108 citations
- Leveraging GPT-4 for Automatic Translation Post-EditingFindings of the Association for Computational LinguisticsVikas Raunak, Amr Sharaf, Yiren Wang, et al.2023 · 108 citations
- Benchmarking Foundation Models with Language-Model-as-an-ExaminerConference on Neural Information Processing Systems (NeurIPS)Yushi Bai, Jiahao Ying, Yixin Cao, et al.2023 · 106 citations
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
- Disentangling Length from Quality in Direct Preference OptimizationFindings of the Association for Computational LinguisticsRyan Park, Rafael Rafailov, Stefano Ermon, et al.2024 · 105 citations
- Inverse Scaling: When Bigger Isn't BetterarXiv:2306.09479 · Transactions on Machine Learning Research (TMLR), 10/2023, https://openreview.net/forum?id=DwgRm72GQFIan R. McKenzie, Alexander Lyzhov, Michael Pieler, et al.2023 · 105 citations
- Model evaluation for extreme risksarXiv:2305.15324Toby Shevlane, Sebastian Farquhar, Ben Garfinkel, et al.2023 · 104 citations
- MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 103 citations
- BLOOM+1: Adding Language Support to BLOOM for Zero-Shot PromptingAnnual Meeting of the Association for Computational Linguistics (ACL)Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, et al.2023 · 102 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- FELM: Benchmarking Factuality Evaluation of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shiqi Chen, Yiran Zhao, Jinghan Zhang, et al.2023 · 99 citations
- A Survey of Confidence Estimation and Calibration in Large Language ModelsarXiv:2311.08298Jiahui Geng, Fengyu Cai, Yuxia Wang, et al.2023 · 97 citations
- On Learning to Summarize with Large Language Models as ReferencesConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yixin Liu, Kejian Shi, Katherine He, et al.2024 · 94 citations
- Do-Not-Answer: Evaluating Safeguards in LLMsFindings of the Association for Computational LinguisticsYuxia Wang, Haonan Li, Xudong Han, et al.2024 · 93 citations
- LLMs Are Few-Shot In-Context Low-Resource Language LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Samuel Cahyawijaya, Holy Lovenia, Pascale Fung2024 · 93 citations
- On the Tool Manipulation Capability of Open-source Large Language ModelsarXiv:2305.16504Qiantong Xu, Fenglu Hong, Bo Li, et al.2023 · 92 citations
- “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language ModelsFindings of the Association for Computational LinguisticsXinpeng Wang, Bolei Ma, Chengzhi Hu, et al.2024 · 91 citations
- SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific ResearchProceedings of the AAAI Conference on Artificial IntelligenceLiangtai Sun, Yang Han, Zihan Zhao, et al.2023 · 91 citations
- AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
- Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence TasksConference on Empirical Methods in Natural Language Processing (EMNLP)Andrea Sottana, Bin Liang, Kai Zou, et al.2023 · 89 citations
- Large Language Models as General Pattern MachinesarXiv:2307.04721Suvir Mirchandani, Fei Xia, Pete Florence, et al.2023 · 88 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Rethinking Interpretability in the Era of Large Language ModelsarXiv:2402.01761Chandan Singh, Jeevana Priya Inala, Michel Galley, et al.2024 · 87 citations
- A Survey of Large Language Models in Medicine: Progress, Application, and ChallengearXiv:2311.05112Hongjian Zhou, Fenglin Liu, Boyang Gu, et al.2023 · 87 citations
- PaperBench: Evaluating AI's Ability to Replicate AI ResearcharXiv:2504.01848Giulio Starace, Oliver Jaffe, Dane Sherburn, et al.2025 · 86 citations
- Machine Unlearning of Pre-trained Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jin Yao, Eli Chien, Minxin Du, et al.2024 · 86 citations
- A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and EthicsarXiv:2310.05694Kai He, Rui Mao, Qika Lin, et al.2023 · 86 citations
- SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural ReasoningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Zhengyuan Liu, Xin Huang, et al.2024 · 85 citations
- Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD ExamplesConference on Neural Information Processing Systems (NeurIPS)Abulhair Saparov, Richard Yuanzhe Pang, Vishakh Padmakumar, et al.2023 · 84 citations
- PRD: Peer Rank and Discussion Improve Large Language Model based EvaluationsarXiv:2307.02762Ruosen Li, Teerth Patel, Xinya Du2023 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- Does Writing with Language Models Reduce Content Diversity?arXiv:2309.05196Vishakh Padmakumar, He He2023 · 82 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific DiscoveryarXiv:2410.05080Ziru Chen, Shijie Chen, Yuting Ning, et al.2024 · 81 citations
- KoBBQ: Korean Bias Benchmark for Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Jiho Jin, Jiseon Kim, Nayeon Lee, et al.2024 · 78 citations
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMsarXiv:2308.13387Yuxia Wang, Haonan Li, Xudong Han, et al.2023 · 78 citations
- MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, et al.2024 · 74 citations
- When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model LeaderboardsarXiv:2402.01781Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, et al.2024 · 74 citations
- AlignBench: Benchmarking Chinese Alignment of Large Language ModelsarXiv:2311.18743Xiao Liu, Xuanyu Lei, Shengyuan Wang, et al.2023 · 74 citations
- Large Language Models as Analogical ReasonersarXiv:2310.01714Michihiro Yasunaga, Xinyun Chen, Yujia Li, et al.2023 · 74 citations
- Benchmarking Benchmark Leakage in Large Language ModelsarXiv:2404.18824Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.2024 · 73 citations
- Towards Safer Large Language Models through Machine UnlearningFindings of the Association for Computational LinguisticsZheyuan Liu, Guangyao Dou, Zhaoxuan Tan, et al.2024 · 72 citations
- Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning PerformancearXiv:2305.17306Yao Fu, Litu Ou, Mingyu Chen, et al.2023 · 72 citations
- Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective RewardsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxiang Wang, Yong Lin, Wei Xiong, et al.2024 · 68 citations
- Branch-Solve-Merge Improves Large Language Model Evaluation and GenerationarXiv:2310.15123Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, et al.2023 · 68 citations
- Phoenix: Democratizing ChatGPT across LanguagesarXiv:2304.10453Zhihong Chen, Feng Jiang, Junying Chen, et al.2023 · 68 citations
- ARB: Advanced Reasoning Benchmark for Large Language ModelsarXiv:2307.13692Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, et al.2023 · 66 citations
- CycleResearcher: Improving Automated Research via Automated ReviewarXiv:2411.00816Yixuan Weng, Minjun Zhu, Guangsheng Bao, et al.2024 · 65 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Evaluation of OpenAI o1: Opportunities and Challenges of AGIarXiv:2409.18486Tianyang Zhong, Zhengliang Liu, Yi Pan, et al.2024 · 64 citations
- CValues: Measuring the Values of Chinese Large Language Models from Safety to ResponsibilityarXiv:2307.09705Guohai Xu, Jiayi Liu, Ming Yan, et al.2023 · 64 citations
- What Did I Do Wrong? Quantifying LLMs' Sensitivity and Consistency to Prompt EngineeringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Federico Errica, Davide Sanvito, Giuseppe Siracusano, et al.2025 · 63 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
- LAB-Bench: Measuring Capabilities of Language Models for Biology ResearcharXiv:2407.10362Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, et al.2024 · 62 citations
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMsarXiv:2411.14199Akari Asai, Jacqueline He, Rulin Shao, et al.2024 · 62 citations
- Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
- SatLM: Satisfiability-Aided Language Models Using Declarative PromptingConference on Neural Information Processing Systems (NeurIPS)Xi Ye, Qiaochu Chen, Isil Dillig, et al.2023 · 62 citations
- Teaching Large Language Models to Reason with Reinforcement LearningarXiv:2403.04642Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, et al.2024 · 61 citations
- Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Yongqi Tong, Dawei Li, Sizhe Wang, et al.2024 · 57 citations
- Dialect prejudice predicts AI decisions about people's character, employability, and criminalityarXiv:2403.00742Valentin Hofmann, Pratyusha Ria Kalluri, Dan Jurafsky, et al.2024 · 57 citations
- SuperCLUE: A Comprehensive Chinese Large Language Model BenchmarkarXiv:2307.15020Liang Xu, Anqi Li, Lei Zhu, et al.2023 · 57 citations
- Parsel: Algorithmic Reasoning with Language Models by Composing DecompositionsConference on Neural Information Processing Systems (NeurIPS)Eric Zelikman, Qian Huang, Gabriel Poesia, et al.2023 · 56 citations
- AI Agents That MatterarXiv:2407.01502Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, et al.2024 · 55 citations
- Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?Annual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Abhilasha Ravichander, Rachel Rudinger2024 · 52 citations
- On the application of Large Language Models for language teaching and assessment technologyarXiv:2307.08393Andrew Caines, Luca Benedetto, Shiva Taslimipoor, et al.2023 · 51 citations
- Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?Language Resources and Evaluation Conference (LREC)Wangyue Li, Liangzhi Li, Tong Xiang, et al.2024 · 47 citations
- Metaphor Understanding Challenge Dataset for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Tong, Rochelle Choenni, Martha Lewis, et al.2024 · 47 citations
- GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local RefinementsarXiv:2402.10963Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, et al.2024 · 45 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
- When does In-context Learning Fall Short and Why? A Study on Specification-Heavy TasksarXiv:2311.08993Hao Peng, Xiaozhi Wang, Jianhui Chen, et al.2023 · 42 citations
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow InstructionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Orion Weller, Benjamin Chang, Sean MacAvaney, et al.2025 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- Sociodemographic Bias in Language Models: A Survey and Forward PathWorkshop on Gender Bias in Natural Language ProcessingVipul Gupta, Pranav Narayanan Venkit, Shomir Wilson, et al.2023 · 40 citations
- Introducing v0.5 of the AI Safety Benchmark from MLCommonsarXiv:2404.12241Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, et al.2024 · 38 citations
- Through the Lens of Core Competency: Survey on Evaluation of Large Language ModelsarXiv:2308.07902Ziyu Zhuang, Qiguang Chen, Longxuan Ma, et al.2023 · 35 citations
- Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge EvaluationarXiv:2306.05783Zhouhong Gu, Xiaoxuan Zhu, Haoning Ye, et al.2023 · 34 citations
- SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model SafetyarXiv:2404.05399Paul Rottger, Fabio Pernisi, Bertie Vidgen, et al.2024 · 33 citations
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsarXiv:2309.06085Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, et al.2023 · 33 citations
- ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level CodearXiv:2311.09835Xiangru Tang, Yuliang Liu, Zefan Cai, et al.2023 · 33 citations
- Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM EvaluationInternational Conference on Computational Linguistics (COLING)Siyuan Wang, Zhuohan Long, Zhihao Fan, et al.2025 · 30 citations
- Contextualization Distillation from Large Language Model for Knowledge Graph CompletionFindings of the Association for Computational LinguisticsDawei Li, Zhen Tan, Tianlong Chen, et al.2024 · 30 citations
- Jamba-1.5: Hybrid Transformer-Mamba Models at ScalearXiv:2408.12570Jamba Team: Barak Lenz, Alan Arazi, Amir Bergman, et al.2024 · 30 citations
- Language Models as Science TutorsarXiv:2402.11111Alexis Chevalier, Jiayi Geng, Alexander Wettig, et al.2024 · 30 citations
- Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningConference on Computational Natural Language Learning (CoNLL)Lucas Weber, Elia Bruni, Dieuwke Hupkes2023 · 29 citations
- Baichuan-Omni-1.5 Technical ReportarXiv:2501.15368Yadong Li, Jun Liu, Tao Zhang, et al.2025 · 28 citations
- Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/qian-huang/cited-by/page/2/