Who cites «Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena»
- MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language BenchmarkarXiv:2402.04788Dongping Chen, Ruoxi Chen, Shilin Zhang, et al.2024 · 60 citations
- Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-TuningarXiv:2402.00530Ming Li, Yong Zhang, Shwai He, et al.2024 · 60 citations
- Generalizing Verifiable Instruction FollowingConference on Neural Information Processing Systems (NeurIPS)Valentina Pyatkin, Saumya Malik, Victoria Graf, et al.2025 · 59 citations
- BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsLanguage Resources and Evaluation Conference (LREC)Zican Dong, Tianyi Tang, Junyi Li, et al.2024 · 59 citations
- Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task ArithmeticAnnual Meeting of the Association for Computational Linguistics (ACL)Rishabh Bhardwaj, Duc Anh Do, Soujanya Poria2024 · 59 citations
- EQ-Bench: An Emotional Intelligence Benchmark for Large Language ModelsarXiv:2312.06281Samuel J. Paech2023 · 59 citations
- Unintended Impacts of LLM Alignment on Global RepresentationAnnual Meeting of the Association for Computational Linguistics (ACL)Michael J Ryan, William Held, Diyi Yang2024 · 57 citations
- SuperCLUE: A Comprehensive Chinese Large Language Model BenchmarkarXiv:2307.15020Liang Xu, Anqi Li, Lei Zhu, et al.2023 · 57 citations
- PlanGenLLMs: A Modern Survey of LLM Planning CapabilitiesAnnual Meeting of the Association for Computational Linguistics (ACL)Hui Wei, Zihao Zhang, Shenghua He, et al.2025 · 55 citations
- Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse PromptsAnnual Meeting of the Association for Computational Linguistics (ACL)Xuan-Phi Nguyen, Mahani Aljunied, Shafiq Joty, et al.2024 · 55 citations
- CMB: A Comprehensive Medical Benchmark in ChinesearXiv:2308.08833Xidong Wang, Guiming Hardy Chen, Dingjie Song, et al.2023 · 54 citations
- AEGIS2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM GuardrailsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Shaona Ghosh, Prasoon Varshney, Makesh Narsimhan Sreedhar, et al.2025 · 53 citations
- RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and StylearXiv:2410.16184Yantao Liu, Zijun Yao, Rui Min, et al.2024 · 53 citations
- The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Nitay Calderon, Roi Reichart, Rotem Dror2025 · 52 citations
- WebDancer: Towards Autonomous Information Seeking AgencyConference on Neural Information Processing Systems (NeurIPS)Jialong Wu, Baixuan Li, Runnan Fang, et al.2025 · 50 citations
- Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference FeedbackConference on Neural Information Processing Systems (NeurIPS)Hamish Ivison, Yizhong Wang, Jiacheng Liu, et al.2024 · 50 citations
- TIGERScore: Towards Building Explainable Metric for All Text Generation TasksarXiv:2310.00752Dongfu Jiang, Yishan Li, Ge Zhang, et al.2023 · 50 citations
- LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Fengqi Zhu, Rongzhen Wang, Shen Nie, et al.2026 · 49 citations
- RM-R1: Reward Modeling as ReasoningarXiv:2505.02387Xiusi Chen, Gaotang Li, Ziqi Wang, et al.2025 · 49 citations
- The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce HarmConference on Empirical Methods in Natural Language Processing (EMNLP)Aakanksha, Arash Ahmadian, Beyza Ermis, et al.2024 · 49 citations
- Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?Language Resources and Evaluation Conference (LREC)Wangyue Li, Liangzhi Li, Tong Xiang, et al.2024 · 47 citations
- MixEval: Deriving Wisdom of the Crowd from LLM Benchmark MixturesConference on Neural Information Processing Systems (NeurIPS)Jinjie Ni, Fuzhao Xue, Xiang Yue, et al.2024 · 47 citations
- A Human-Inspired Reading Agent with Gist Memory of Very Long ContextsarXiv:2402.09727Kuang-Huei Lee, Xinyun Chen, Hiroki Furuta, et al.2024 · 46 citations
- ARGS: Alignment as Reward-Guided SearcharXiv:2402.01694Maxim Khanov, Jirayu Burapacheep, Yixuan Li2024 · 46 citations
- Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations
- EuroLLM-9B: Technical ReportarXiv:2506.04079Pedro Henrique Martins, Joao Alves, Patrick Fernandes, et al.2025 · 45 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- LUQ: Long-text Uncertainty Quantification for LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Caiqi Zhang, Fangyu Liu, Marco Basaldella, et al.2024 · 42 citations
- Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time ScalingarXiv:2502.06703Runze Liu, Junqi Gao, Jian Zhao, et al.2025 · 41 citations
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research AgentsarXiv:2506.11763Mingxuan Du, Benfeng Xu, Chiwei Zhu, et al.2025 · 41 citations
- LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256KarXiv:2402.05136Tao Yuan, Xuefei Ning, Dong Zhou, et al.2024 · 41 citations
- SALMON: Self-Alignment with Instructable Reward ModelsarXiv:2310.05910Zhiqing Sun, Yikang Shen, Hongxin Zhang, et al.2023 · 41 citations
- A Systematic Survey of Automatic Prompt Optimization TechniquesConference on Empirical Methods in Natural Language Processing (EMNLP)Kiran Ramnath, Kang Zhou, Sheng Guan, et al.2025 · 40 citations
- Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language ModelsarXiv:2404.02823Haoran Sun, Lixin Liu, Junjie Li, et al.2024 · 40 citations
- CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistsConference on Empirical Methods in Natural Language Processing (EMNLP)Yukyung Lee, JoongHoon Kim, Jaehee Kim, et al.2025 · 37 citations
- Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Fakhraddin Alwajih, Abdellah El Mekki, Samar Mohamed Magdy, et al.2025 · 37 citations
- Aligning Large Language Models with Human Preferences through Representation EngineeringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhao Liu, Xiaohua Wang, Muling Wu, et al.2024 · 37 citations
- Direct Judgement Preference OptimizationConference on Empirical Methods in Natural Language Processing (EMNLP)PeiFeng Wang, Austin Xu, Yilun Zhou, et al.2025 · 35 citations
- Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language ModelsarXiv:2411.07140Yancheng He, Shilong Li, Jiaheng Liu, et al.2024 · 34 citations
- MiMo-VL Technical ReportarXiv:2506.03569Xiaomi LLM-Core Team, Zihao Yue, Zhenru Lin, et al.2025 · 33 citations
- Me LLaMA: Foundation Large Language Models for Medical ApplicationsarXiv:2402.12749Qianqian Xie, Qingyu Chen, Aokun Chen, et al.2024 · 33 citations
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsarXiv:2309.06085Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, et al.2023 · 33 citations
- OPT-Tree: Speculative Decoding with Adaptive Draft Tree StructureTransactions of the Association for Computational Linguistics (TACL)Jikai Wang, Yi Su, Juntao Li, et al.2025 · 32 citations
- The FACTS Grounding Leaderboard: Benchmarking LLMs' Ability to Ground Responses to Long-Form InputarXiv:2501.03200Alon Jacovi, Andrew Wang, Chris Alberti, et al.2025 · 32 citations
- Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM InteractionsJoint Conference on Lexical and Computational Semantics (*SEM)Huachuan Qiu, Zhenzhong Lan2026 · 31 citations
- Airavata: Introducing Hindi Instruction-tuned LLMarXiv:2401.15006Jay Gala, Thanmay Jayakumar, Jaavid Aktar Husain, et al.2024 · 31 citations
- Learning Planning-based Reasoning by Trajectories Collection and Process Reward SynthesizingConference on Empirical Methods in Natural Language Processing (EMNLP)Fangkai Jiao, Chengwei Qin, Zhengyuan Liu, et al.2024 · 31 citations
- Weaver: Foundation Models for Creative WritingarXiv:2401.17268Tiannan Wang; Jiamin Chen; Qingrui Jia; Shuai Wang; Ruoyu Fang; Huilin Wang; Zhaowei Gao; Chunzhao Xie; Chuou Xu; Jihong Dai; Yibin Liu; Jialong Wu; Shengwei Ding; Long Li; Zhiwei Huang; Xinle Deng; Teng Yu; Gangan Ma; Han Xiao; Zixin Chen; Danjun Xiang; Yunxia Wang; Yuanyuan Zhu; Yi Xiao; Jing Wang; Yiru Wang; Siran Ding; Jiayang Huang; Jiayi Xu; Yilihamu Tayier; Zhenyu Hu; Yuan Gao; Chengfeng Zheng; Yueshu Ye; Yihang Li; Lei Wan; Xinyue Jiang; Yujie Wang; Siyu Cheng; Zhule Song; Xiangru Tang; Xiaohua Xu; Ningyu Zhang; Huajun Chen; Yuchen Eleanor Jiang;, Wangchunshu Zhou2024 · 31 citations
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Tao Zhang, ChengLIn Zhu, Yanjun Shen, et al.2025 · 30 citations
- PPTAgent: Generating and Evaluating Presentations Beyond Text-to-SlidesConference on Empirical Methods in Natural Language Processing (EMNLP)Hao Zheng, Xinyan Guan, Hao Kong, et al.2025 · 30 citations
- ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique PipelinearXiv:2404.02893Yifan Xu, Xiao Liu, Xinghan Liu, et al.2024 · 30 citations
- CIDAR: Culturally Relevant Instruction Dataset For ArabicFindings of the Association for Computational LinguisticsZaid Alyafeai, Khalid Almubarak, Ahmed Ashraf, et al.2024 · 30 citations
- Language Models as Science TutorsarXiv:2402.11111Alexis Chevalier, Jiayi Geng, Alexander Wettig, et al.2024 · 30 citations
- ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Haochen Tan, Zhijiang Guo, Zhan Shi, et al.2024 · 30 citations
- RMB: Comprehensively Benchmarking Reward Models in LLM AlignmentarXiv:2410.09893Enyu Zhou, Guodong Zheng, Binghai Wang, et al.2024 · 30 citations
- Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language ModelsarXiv:2402.14714Seungduk Kim, Seungtaek Choi, Myeongho Jeong2024 · 29 citations
- Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
- ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Faris Hijazi, Somayah AlHarbi, Abdulaziz AlHussein, et al.2024 · 28 citations
- Automatic Instruction Evolving for Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Weihao Zeng, Can Xu, Yingxiu Zhao, et al.2024 · 28 citations
- PLUG: Leveraging Pivot Language in Cross-Lingual Instruction TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Zhihan Zhang, Dong-Ho Lee, Yuwei Fang, et al.2024 · 28 citations
- Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model PerformanceConference on Empirical Methods in Natural Language Processing (EMNLP)Omer Nahum, Nitay Calderon, Orgad Keller, et al.2025 · 27 citations
- CaLMQA: Exploring culturally specific long-form question answering across 23 languagesAnnual Meeting of the Association for Computational Linguistics (ACL)Shane Arora, Marzena Karpinska, Hung-Ting Chen, et al.2025 · 27 citations
- OmniFlatten: An End-to-end GPT Model for Seamless Voice ConversationAnnual Meeting of the Association for Computational Linguistics (ACL)Qinglin Zhang, Luyao Cheng, Chong Deng, et al.2025 · 27 citations
- Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
- LLM-as-a-Judge & Reward Model: What They Can and Cannot DoarXiv:2409.11239Guijin Son, Hyunwoo Ko, Hoyoung Lee, et al.2024 · 27 citations
- Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal SamplingarXiv:2408.16737Hritik Bansal, Arian Hosseini, Rishabh Agarwal, et al.2024 · 27 citations
- Binary Classifier Optimization for Large Language Model AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL)Seungjae Jung, Gunsoo Han, Daniel Wontae Nam, et al.2025 · 26 citations
- Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Haneul Yoo, Yongjin Yang, Hwaran Lee2025 · 26 citations
- Do Large Language Models have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yanzhu Guo, Simone Conia, Zelin Zhou, et al.2025 · 25 citations
- FuseChat: Knowledge Fusion of Chat ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Fanqi Wan, Longguang Zhong, Ziyi Yang, et al.2025 · 25 citations
- Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by TencentarXiv:2411.02265Xingwu Sun, Yanfeng Chen, Yiqing Huang, et al.2024 · 25 citations
- IberoBench: A Benchmark for LLM Evaluation in Iberian LanguagesInternational Conference on Computational Linguistics (COLING)Irene Baucells, Javier Aula-Blasco, Iria de-Dios-Flores, et al.2025 · 24 citations
- LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-SteeringAnnual Meeting of the Association for Computational Linguistics (ACL)Jinhe Bi, Yujun Wang, Haokun Chen, et al.2025 · 24 citations
- Protecting Privacy in Multimodal Large Language Models with MLLMU-BenchConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zheyuan Liu, Guangyao Dou, Mengzhao Jia, et al.2025 · 24 citations
- Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language ModelarXiv:2404.04167Xinrun Du; Zhouliang Yu; Songyang Gao; Ding Pan; Yuyang Cheng; Ziyang Ma; Ruibin Yuan; Xingwei Qu; Jiaheng Liu; Tianyu Zheng; Xinchen Luo; Guorui Zhou; Wenhu Chen;, Ge Zhang2024 · 23 citations
- Following Length Constraints in InstructionsConference on Empirical Methods in Natural Language Processing (EMNLP)Weizhe Yuan, Ilia Kulikov, Ping Yu, et al.2025 · 22 citations
- From Selection to Generation: A Survey of LLM-based Active LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, et al.2025 · 22 citations
- MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation EvaluatorsInternational Conference on Computational Linguistics (COLING)Qingyu Lu, Liang Ding, Kanjian Zhang, et al.2025 · 22 citations
- Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token RecyclingAnnual Meeting of the Association for Computational Linguistics (ACL)Xianzhen Luo, Yixuan Wang, Qingfu Zhu, et al.2025 · 22 citations
- A Hard Nut to Crack: Idiom Detection with Conversational Large Language ModelsWorkshop on Figurative Language ProcessingFrancesca De Luca Fornaciari, Begoña Altuna, Itziar Gonzalez-Dios, et al.2024 · 22 citations
- Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-GenerationarXiv:2410.02725Rohin Manvi, Anikait Singh, Stefano Ermon2024 · 22 citations
- Intention Analysis Makes LLMs A Good Jailbreak DefenderInternational Conference on Computational Linguistics (COLING)Yuqi Zhang, Liang Ding, Lefei Zhang, et al.2025 · 21 citations
- LongReward: Improving Long-context Large Language Models with AI FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL)Jiajie Zhang, Zhongni Hou, Xin Lv, et al.2025 · 21 citations
- M-LongDoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning FrameworkConference on Empirical Methods in Natural Language Processing (EMNLP)Yew Ken Chia, Liying Cheng, Hou Pong Chan, et al.2025 · 21 citations
- Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from JailbreakingConference on Empirical Methods in Natural Language Processing (EMNLP)Junda Zhu, Lingyong Yan, Shuaiqiang Wang, et al.2025 · 21 citations
- RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World ScenariosAnnual Meeting of the Association for Computational Linguistics (ACL)Ruiwen Zhou, Wenyue Hua, Liangming Pan, et al.2025 · 21 citations
- DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIFindings of the Association for Computational LinguisticsJianguo Zhang, Kun Qian, Zhiwei Liu, et al.2023 · 21 citations
- Can Unconfident LLM Annotations Be Used for Confident Conclusions?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kristina Gligorić, Tijana Zrnic, Cinoo Lee, et al.2025 · 19 citations
- Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Dayu Yang, Tianyang Liu, Daoan Zhang, et al.2025 · 19 citations
- sDPO: Don't Use Your Data All at OncearXiv:2403.19270Dahyun Kim, Yungi Kim, Wonho Song, et al.2024 · 19 citations
- Timo: Towards Better Temporal Reasoning for Language ModelsarXiv:2406.14192Zhaochen Su, Jun Zhang, Tong Zhu, et al.2024 · 19 citations
- Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language modelsarXiv:2405.02287Piotr Padlewski, Max Bain, Matthew Henderson, et al.2024 · 19 citations
- Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic DialectWorkshop on Language Models for Low-Resource LanguagesGuokan Shang, Hadi Abdine, Yousef Khoubrane, et al.2025 · 18 citations
- Benchmarking LLMs for Translating Classical Chinese Poetry: Evaluating Adequacy, Fluency, and EleganceConference on Empirical Methods in Natural Language Processing (EMNLP)Andong Chen, Lianzhang Lou, Kehai Chen, et al.2025 · 18 citations
- Hallucination Detection in LLMs Using Spectral Features of Attention MapsConference on Empirical Methods in Natural Language Processing (EMNLP)Jakub Binkowski, Denis Janiak, Albert Sawczyn, et al.2025 · 18 citations
- LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution ShiftsAnnual Meeting of the Association for Computational Linguistics (ACL)Qibing Ren, Hao Li, Dongrui Liu, et al.2025 · 18 citations
- VerIF: Verification Engineering for Reinforcement Learning in Instruction FollowingConference on Empirical Methods in Natural Language Processing (EMNLP)Hao Peng, Yunjia Qi, Xiaozhi Wang, et al.2025 · 18 citations
- FormalAlign: Automated Alignment Evaluation for AutoformalizationarXiv:2410.10135Jianqiao Lu, Yingjia Wan, Yinya Huang, et al.2024 · 18 citations
- Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance ClassificationarXiv:2309.13734Iain J. Cruickshank, Lynnette Hui Xian Ng2023 · 18 citations
- Understanding Jailbreak Success: A Study of Latent Space Dynamics in Large Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Sarah Ball, Frauke Kreuter, Nina Panickssery2026 · 17 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/zheng-2023-judging-llm-judge-mt-bench/cited-by/page/3/