Who cites «Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena»
- Aligning Large Language Models with Human Preferences through Representation EngineeringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhao Liu, Xiaohua Wang, Muling Wu, et al.2024 · 37 citations
- Direct Judgement Preference OptimizationConference on Empirical Methods in Natural Language Processing (EMNLP)PeiFeng Wang, Austin Xu, Yilun Zhou, et al.2025 · 35 citations
- Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language ModelsarXiv:2411.07140Yancheng He, Shilong Li, Jiaheng Liu, et al.2024 · 34 citations
- MiMo-VL Technical ReportarXiv:2506.03569Xiaomi LLM-Core Team, Zihao Yue, Zhenru Lin, et al.2025 · 33 citations
- Me LLaMA: Foundation Large Language Models for Medical ApplicationsarXiv:2402.12749Qianqian Xie, Qingyu Chen, Aokun Chen, et al.2024 · 33 citations
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsarXiv:2309.06085Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, et al.2023 · 33 citations
- OPT-Tree: Speculative Decoding with Adaptive Draft Tree StructureTransactions of the Association for Computational Linguistics (TACL)Jikai Wang, Yi Su, Juntao Li, et al.2025 · 32 citations
- The FACTS Grounding Leaderboard: Benchmarking LLMs' Ability to Ground Responses to Long-Form InputarXiv:2501.03200Alon Jacovi, Andrew Wang, Chris Alberti, et al.2025 · 32 citations
- Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM InteractionsJoint Conference on Lexical and Computational Semantics (*SEM)Huachuan Qiu, Zhenzhong Lan2026 · 31 citations
- Airavata: Introducing Hindi Instruction-tuned LLMarXiv:2401.15006Jay Gala, Thanmay Jayakumar, Jaavid Aktar Husain, et al.2024 · 31 citations
- Learning Planning-based Reasoning by Trajectories Collection and Process Reward SynthesizingConference on Empirical Methods in Natural Language Processing (EMNLP)Fangkai Jiao, Chengwei Qin, Zhengyuan Liu, et al.2024 · 31 citations
- Weaver: Foundation Models for Creative WritingarXiv:2401.17268Tiannan Wang; Jiamin Chen; Qingrui Jia; Shuai Wang; Ruoyu Fang; Huilin Wang; Zhaowei Gao; Chunzhao Xie; Chuou Xu; Jihong Dai; Yibin Liu; Jialong Wu; Shengwei Ding; Long Li; Zhiwei Huang; Xinle Deng; Teng Yu; Gangan Ma; Han Xiao; Zixin Chen; Danjun Xiang; Yunxia Wang; Yuanyuan Zhu; Yi Xiao; Jing Wang; Yiru Wang; Siran Ding; Jiayang Huang; Jiayi Xu; Yilihamu Tayier; Zhenyu Hu; Yuan Gao; Chengfeng Zheng; Yueshu Ye; Yihang Li; Lei Wan; Xinyue Jiang; Yujie Wang; Siyu Cheng; Zhule Song; Xiangru Tang; Xiaohua Xu; Ningyu Zhang; Huajun Chen; Yuchen Eleanor Jiang;, Wangchunshu Zhou2024 · 31 citations
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Tao Zhang, ChengLIn Zhu, Yanjun Shen, et al.2025 · 30 citations
- PPTAgent: Generating and Evaluating Presentations Beyond Text-to-SlidesConference on Empirical Methods in Natural Language Processing (EMNLP)Hao Zheng, Xinyan Guan, Hao Kong, et al.2025 · 30 citations
- ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique PipelinearXiv:2404.02893Yifan Xu, Xiao Liu, Xinghan Liu, et al.2024 · 30 citations
- CIDAR: Culturally Relevant Instruction Dataset For ArabicFindings of the Association for Computational LinguisticsZaid Alyafeai, Khalid Almubarak, Ahmed Ashraf, et al.2024 · 30 citations
- Language Models as Science TutorsarXiv:2402.11111Alexis Chevalier, Jiayi Geng, Alexander Wettig, et al.2024 · 30 citations
- ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Haochen Tan, Zhijiang Guo, Zhan Shi, et al.2024 · 30 citations
- RMB: Comprehensively Benchmarking Reward Models in LLM AlignmentarXiv:2410.09893Enyu Zhou, Guodong Zheng, Binghai Wang, et al.2024 · 30 citations
- Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language ModelsarXiv:2402.14714Seungduk Kim, Seungtaek Choi, Myeongho Jeong2024 · 29 citations
- Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
- ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Faris Hijazi, Somayah AlHarbi, Abdulaziz AlHussein, et al.2024 · 28 citations
- Automatic Instruction Evolving for Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Weihao Zeng, Can Xu, Yingxiu Zhao, et al.2024 · 28 citations
- PLUG: Leveraging Pivot Language in Cross-Lingual Instruction TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Zhihan Zhang, Dong-Ho Lee, Yuwei Fang, et al.2024 · 28 citations
- Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model PerformanceConference on Empirical Methods in Natural Language Processing (EMNLP)Omer Nahum, Nitay Calderon, Orgad Keller, et al.2025 · 27 citations
- CaLMQA: Exploring culturally specific long-form question answering across 23 languagesAnnual Meeting of the Association for Computational Linguistics (ACL)Shane Arora, Marzena Karpinska, Hung-Ting Chen, et al.2025 · 27 citations
- OmniFlatten: An End-to-end GPT Model for Seamless Voice ConversationAnnual Meeting of the Association for Computational Linguistics (ACL)Qinglin Zhang, Luyao Cheng, Chong Deng, et al.2025 · 27 citations
- Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
- LLM-as-a-Judge & Reward Model: What They Can and Cannot DoarXiv:2409.11239Guijin Son, Hyunwoo Ko, Hoyoung Lee, et al.2024 · 27 citations
- Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal SamplingarXiv:2408.16737Hritik Bansal, Arian Hosseini, Rishabh Agarwal, et al.2024 · 27 citations
- Binary Classifier Optimization for Large Language Model AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL)Seungjae Jung, Gunsoo Han, Daniel Wontae Nam, et al.2025 · 26 citations
- Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Haneul Yoo, Yongjin Yang, Hwaran Lee2025 · 26 citations
- Do Large Language Models have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yanzhu Guo, Simone Conia, Zelin Zhou, et al.2025 · 25 citations
- FuseChat: Knowledge Fusion of Chat ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Fanqi Wan, Longguang Zhong, Ziyi Yang, et al.2025 · 25 citations
- Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by TencentarXiv:2411.02265Xingwu Sun, Yanfeng Chen, Yiqing Huang, et al.2024 · 25 citations
- IberoBench: A Benchmark for LLM Evaluation in Iberian LanguagesInternational Conference on Computational Linguistics (COLING)Irene Baucells, Javier Aula-Blasco, Iria de-Dios-Flores, et al.2025 · 24 citations
- LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-SteeringAnnual Meeting of the Association for Computational Linguistics (ACL)Jinhe Bi, Yujun Wang, Haokun Chen, et al.2025 · 24 citations
- Protecting Privacy in Multimodal Large Language Models with MLLMU-BenchConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zheyuan Liu, Guangyao Dou, Mengzhao Jia, et al.2025 · 24 citations
- Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language ModelarXiv:2404.04167Xinrun Du; Zhouliang Yu; Songyang Gao; Ding Pan; Yuyang Cheng; Ziyang Ma; Ruibin Yuan; Xingwei Qu; Jiaheng Liu; Tianyu Zheng; Xinchen Luo; Guorui Zhou; Wenhu Chen;, Ge Zhang2024 · 23 citations
- Following Length Constraints in InstructionsConference on Empirical Methods in Natural Language Processing (EMNLP)Weizhe Yuan, Ilia Kulikov, Ping Yu, et al.2025 · 22 citations
- From Selection to Generation: A Survey of LLM-based Active LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, et al.2025 · 22 citations
- MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation EvaluatorsInternational Conference on Computational Linguistics (COLING)Qingyu Lu, Liang Ding, Kanjian Zhang, et al.2025 · 22 citations
- Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token RecyclingAnnual Meeting of the Association for Computational Linguistics (ACL)Xianzhen Luo, Yixuan Wang, Qingfu Zhu, et al.2025 · 22 citations
- A Hard Nut to Crack: Idiom Detection with Conversational Large Language ModelsWorkshop on Figurative Language ProcessingFrancesca De Luca Fornaciari, Begoña Altuna, Itziar Gonzalez-Dios, et al.2024 · 22 citations
- Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-GenerationarXiv:2410.02725Rohin Manvi, Anikait Singh, Stefano Ermon2024 · 22 citations
- Intention Analysis Makes LLMs A Good Jailbreak DefenderInternational Conference on Computational Linguistics (COLING)Yuqi Zhang, Liang Ding, Lefei Zhang, et al.2025 · 21 citations
- LongReward: Improving Long-context Large Language Models with AI FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL)Jiajie Zhang, Zhongni Hou, Xin Lv, et al.2025 · 21 citations
- M-LongDoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning FrameworkConference on Empirical Methods in Natural Language Processing (EMNLP)Yew Ken Chia, Liying Cheng, Hou Pong Chan, et al.2025 · 21 citations
- Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from JailbreakingConference on Empirical Methods in Natural Language Processing (EMNLP)Junda Zhu, Lingyong Yan, Shuaiqiang Wang, et al.2025 · 21 citations
- RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World ScenariosAnnual Meeting of the Association for Computational Linguistics (ACL)Ruiwen Zhou, Wenyue Hua, Liangming Pan, et al.2025 · 21 citations
- DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIFindings of the Association for Computational LinguisticsJianguo Zhang, Kun Qian, Zhiwei Liu, et al.2023 · 21 citations
- Can Unconfident LLM Annotations Be Used for Confident Conclusions?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kristina Gligorić, Tijana Zrnic, Cinoo Lee, et al.2025 · 19 citations
- Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Dayu Yang, Tianyang Liu, Daoan Zhang, et al.2025 · 19 citations
- sDPO: Don't Use Your Data All at OncearXiv:2403.19270Dahyun Kim, Yungi Kim, Wonho Song, et al.2024 · 19 citations
- Timo: Towards Better Temporal Reasoning for Language ModelsarXiv:2406.14192Zhaochen Su, Jun Zhang, Tong Zhu, et al.2024 · 19 citations
- Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language modelsarXiv:2405.02287Piotr Padlewski, Max Bain, Matthew Henderson, et al.2024 · 19 citations
- Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic DialectWorkshop on Language Models for Low-Resource LanguagesGuokan Shang, Hadi Abdine, Yousef Khoubrane, et al.2025 · 18 citations
- Benchmarking LLMs for Translating Classical Chinese Poetry: Evaluating Adequacy, Fluency, and EleganceConference on Empirical Methods in Natural Language Processing (EMNLP)Andong Chen, Lianzhang Lou, Kehai Chen, et al.2025 · 18 citations
- Hallucination Detection in LLMs Using Spectral Features of Attention MapsConference on Empirical Methods in Natural Language Processing (EMNLP)Jakub Binkowski, Denis Janiak, Albert Sawczyn, et al.2025 · 18 citations
- LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution ShiftsAnnual Meeting of the Association for Computational Linguistics (ACL)Qibing Ren, Hao Li, Dongrui Liu, et al.2025 · 18 citations
- VerIF: Verification Engineering for Reinforcement Learning in Instruction FollowingConference on Empirical Methods in Natural Language Processing (EMNLP)Hao Peng, Yunjia Qi, Xiaozhi Wang, et al.2025 · 18 citations
- FormalAlign: Automated Alignment Evaluation for AutoformalizationarXiv:2410.10135Jianqiao Lu, Yingjia Wan, Yinya Huang, et al.2024 · 18 citations
- Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance ClassificationarXiv:2309.13734Iain J. Cruickshank, Lynnette Hui Xian Ng2023 · 18 citations
- Understanding Jailbreak Success: A Study of Latent Space Dynamics in Large Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Sarah Ball, Frauke Kreuter, Nina Panickssery2026 · 17 citations
- ChatGLM-RLHF: Practices of Aligning Large Language Models with Human FeedbackarXiv:2404.00934Zhenyu Hou, Yilin Niu, Zhengxiao Du, et al.2024 · 17 citations
- NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User QueriesFindings of the Association for Computational LinguisticsShudan Zhang, Hanlin Zhao, Xiao Liu, et al.2024 · 17 citations
- Orion-14B: Open-source Multilingual Large Language ModelsarXiv:2401.12246Du Chen, Yi Huang, Xiaopu Li, et al.2024 · 17 citations
- Auto-Arena: Automating LLM Evaluations with Agent Peer Battles and Committee DiscussionsAnnual Meeting of the Association for Computational Linguistics (ACL)Ruochen Zhao, Wenxuan Zhang, Yew Ken Chia, et al.2025 · 16 citations
- Evaluating the Consistency of LLM EvaluatorsInternational Conference on Computational Linguistics (COLING)Noah Lee, Jiwoo Hong, James Thorne2025 · 16 citations
- LegalReasoner: Step-wised Verification-Correction for Legal Judgment ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Weijie Shi, Han Zhu, Jiaming Ji, et al.2025 · 16 citations
- Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference LabelsConference on Neural Information Processing Systems (NeurIPS)Jan-Philipp Franken, Eric Zelikman, Rafael Rafailov, et al.2024 · 16 citations
- VinaLLaMA: LLaMA-based Vietnamese Foundation ModelarXiv:2312.11011Quan Nguyen, Huy Pham, Dung Dao2023 · 16 citations
- CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-JudgesAnnual Meeting of the Association for Computational Linguistics (ACL)Haitao Li, Junjie Chen, Qingyao Ai, et al.2025 · 15 citations
- CURIE: Evaluating LLMs On Multitask Scientific Long Context Understanding and ReasoningarXiv:2503.13517Hao Cui, Zahra Shamsi, Gowoon Cheon, et al.2025 · 15 citations
- Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument GenerationInternational Conference on Computational Linguistics (COLING)Zhe Hu, Hou Pong Chan, Jing Li, et al.2025 · 15 citations
- FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hongzhan Lin, Yang Deng, Yuxuan Gu, et al.2025 · 15 citations
- FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative SamplingAnnual Meeting of the Association for Computational Linguistics (ACL)Weilin Zhao, Tengyu Pan, Xu Han, et al.2025 · 15 citations
- Improve LLM-as-a-Judge Ability as a General AbilityConference on Empirical Methods in Natural Language Processing (EMNLP)Jiachen Yu, Shaoning Sun, Xiaohui Hu, et al.2025 · 15 citations
- JuStRank: Benchmarking LLM Judges for System RankingAnnual Meeting of the Association for Computational Linguistics (ACL)Ariel Gera, Odellia Boni, Yotam Perlitz, et al.2025 · 15 citations
- Measuring Chain of Thought Faithfulness by Unlearning Reasoning StepsConference on Empirical Methods in Natural Language Processing (EMNLP)Martin Tutek, Fateme Hashemi Chaleshtori, Ana Marasovic, et al.2025 · 15 citations
- MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation SystemsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Nandan Thakur, Suleman Kazi, Ge Luo, et al.2025 · 15 citations
- AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal ArabicFindings of the Association for Computational LinguisticsNathaniel Romney Robinson, Shahd Abdelmoneim, Kelly Marchisio, et al.2025 · 14 citations
- BALSAM: A Platform for Benchmarking Arabic Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Rawan Al-Matham, Kareem Darwish, Raghad Al-Rasheed, et al.2025 · 14 citations
- EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue FrameworkAnnual Meeting of the Association for Computational Linguistics (ACL)Yao Shi, Rongkeng Liang, Yong Xu2025 · 14 citations
- Large Language Models for Automated Literature Review: An Evaluation of Reference Generation, Abstract Writing, and Review CompositionConference on Empirical Methods in Natural Language Processing (EMNLP)Xuemei Tang, Xufeng Duan, Zhenguang Cai2025 · 14 citations
- RAG-Critic: Leveraging Automated Critic-Guided Agentic Workflow for Retrieval Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Guanting Dong, Jiajie Jin, Xiaoxi Li, et al.2025 · 14 citations
- Towards Knowledge Checking in Retrieval-augmented Generation: A Representation PerspectiveConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Shenglai Zeng, Jiankun Zhang, Bingheng Li, et al.2025 · 14 citations
- CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Hongchao Jiang, Yiming Chen, Yushi Cao, et al.2026 · 13 citations
- NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-NeuronsAnnual Meeting of the Association for Computational Linguistics (ACL)Haonan Dong, Kehan Jiang, Haoran Ye, et al.2026 · 13 citations
- PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and RestorationAnnual Meeting of the Association for Computational Linguistics (ACL)Ziqian Zeng, Jianwei Wang, Junyao Yang, et al.2025 · 13 citations
- Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case StudyInternational Conference on Computational Linguistics (COLING)Bowen Li, Wenhan Wu, Ziwei Tang, et al.2025 · 13 citations
- QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement LearningarXiv:2505.17667Fanqi Wan, Weizhou Shen, Shengyi Liao, et al.2025 · 13 citations
- Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to ArtifactsAnnual Meeting of the Association for Computational Linguistics (ACL)Hongyu Chen, Seraphina Goldfarb-Tarrant2025 · 13 citations
- Safety Alignment via Constrained Knowledge UnlearningAnnual Meeting of the Association for Computational Linguistics (ACL)Zesheng Shi, Yucheng Zhou, Jing Li, et al.2025 · 13 citations
- What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific PresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Dongqi Liu, Chenxi Whitehouse, Xi Yu, et al.2025 · 13 citations
- Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal ContextarXiv:2412.17596Kai Ruan, Xuan Wang, Jixiang Hong, et al.2024 · 13 citations
- From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning TasksarXiv:2409.04168Andreas Stephan, Dawei Zhu, Matthias Aßenmacher, et al.2024 · 13 citations
- Language Models can Self-Lengthen to Generate Long TextsarXiv:2410.23933Shanghaoran Quan, Tianyi Tang, Bowen Yu, et al.2024 · 13 citations
- Paralinguistics-Aware Speech-Empowered Large Language Models for Natural ConversationConference on Neural Information Processing Systems (NeurIPS)Heeseung Kim, Soonshin Seo, Kyeongseok Jeong, et al.2024 · 13 citations
- U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMsarXiv:2412.03205Konstantin Chernyshev, Vitaliy Polshkov, Ekaterina Artemova, et al.2024 · 13 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/zheng-2023-judging-llm-judge-mt-bench/cited-by/page/4/