Who cites «Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena»
- Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative DecodingFindings of the Association for Computational LinguisticsHeming Xia, Zhe Yang, Qingxiu Dong, et al.2024 · 146 citations
- How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionAnnual Meeting of the Association for Computational Linguistics (ACL)Guanting Dong, Hongyi Yuan, Keming Lu, et al.2024 · 145 citations
- JudgeLM: Fine-tuned Large Language Models are Scalable JudgesarXiv:2310.17631Lianghui Zhu, Xinggang Wang, Xinlong Wang2023 · 145 citations
- MiniLLM: On-Policy Distillation of Large Language ModelsarXiv:2306.08543Yuxian Gu, Li Dong, Furu Wei, et al.2023 · 144 citations
- Understanding the Effects of RLHF on LLM Generalisation and DiversityarXiv:2310.06452Robert Kirk, Ishita Mediratta, Christoforos Nalmpantis, et al.2023 · 143 citations
- DeepInception: Hypnotize Large Language Model to Be JailbreakerarXiv:2311.03191Xuan Li, Zhanke Zhou, Jianing Zhu, et al.2023 · 141 citations
- Detecting Language Model Attacks with PerplexityarXiv:2308.14132Gabriel Alon, Michael Kamfonas2023 · 141 citations
- MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language FeedbackarXiv:2309.10691Xingyao Wang, Zihan Wang, Jiateng Liu, et al.2023 · 141 citations
- Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-CollaborationarXiv:2307.05300Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, et al.2023 · 140 citations
- Self-Alignment with Instruction BacktranslationarXiv:2308.06259Xian Li, Ping Yu, Chunting Zhou, et al.2023 · 139 citations
- Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse ModelsarXiv:2404.18796Pat Verga, Sebastian Hofstatter, Sophia Althammer, et al.2024 · 138 citations
- To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningarXiv:2409.12183Zayne Sprague, Fangcong Yin, Juan Diego Rodriguez, et al.2024 · 138 citations
- Theory of Mind for Multi-Agent Collaboration via Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Huao Li, Yu Chong, Simon Stepputtis, et al.2023 · 138 citations
- Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language ModelsFindings of the Association for Computational LinguisticsQingyu Lu, Baopu Qiu, Liang Ding, et al.2024 · 136 citations
- InFoBench: Evaluating Instruction Following Ability in Large Language ModelsFindings of the Association for Computational LinguisticsYiwei Qin, Kaiqiang Song, Yebowen Hu, et al.2024 · 136 citations
- ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI ConversationFindings of the Association for Computational LinguisticsZi Lin, Zihan Wang, Yongqi Tong, et al.2023 · 136 citations
- LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context MultitasksarXiv:2412.15204Yushi Bai, Shangqing Tu, Jiajie Zhang, et al.2024 · 135 citations
- Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow InstructionsarXiv:2309.07875Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, et al.2023 · 135 citations
- Secrets of RLHF in Large Language Models Part I: PPOarXiv:2307.04964Rui Zheng, Shihan Dou, Songyang Gao, et al.2023 · 135 citations
- EAGLE-2: Faster Inference of Language Models with Dynamic Draft TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 133 citations
- Jailbreak and Guard Aligned Language Models with Only Few In-Context DemonstrationsarXiv:2310.06387Zeming Wei, Yifei Wang, Ang Li, et al.2023 · 130 citations
- Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
- SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Zhangchen Xu, Fengqing Jiang, Luyao Niu, et al.2024 · 127 citations
- Generative Judge for Evaluating AlignmentarXiv:2310.05470Junlong Li, Shichao Sun, Weizhe Yuan, et al.2023 · 125 citations
- Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
- INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic FeedbackConference on Empirical Methods in Natural Language Processing (EMNLP)Wenda Xu, Danqing Wang, Liangming Pan, et al.2023 · 123 citations
- Best Practices and Lessons Learned on Synthetic DataarXiv:2404.07503Ruibo Liu, Jerry Wei, Fangyu Liu, et al.2024 · 119 citations
- SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language ModelsFindings of the Association for Computational LinguisticsLijun Li, Bowen Dong, Ruohui Wang, et al.2024 · 119 citations
- Large Language Models Understand and Can be Enhanced by Emotional StimuliarXiv:2307.11760Cheng Li, Jindong Wang, Yixuan Zhang, et al.2023 · 116 citations
- Break the Sequential Dependency of LLM Inference Using Lookahead DecodingarXiv:2402.02057Yichao Fu, Peter Bailis, Ion Stoica, et al.2024 · 114 citations
- DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
- GoLLIE: Annotation Guidelines improve Zero-Shot Information-ExtractionarXiv:2310.03668Oscar Sainz, Iker Garcia-Ferrero, Rodrigo Agerri, et al.2023 · 114 citations
- DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world EnvironmentsConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxiang Zheng, Dayuan Fu, Xiangkun Hu, et al.2025 · 113 citations
- ALLaM: Large Language Models for Arabic and EnglisharXiv:2407.15390M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
- Defending Large Language Models Against Jailbreaking Attacks Through Goal PrioritizationAnnual Meeting of the Association for Computational Linguistics (ACL)Zhexin Zhang, Junxiao Yang, Pei Ke, et al.2024 · 113 citations
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Qian Yang, Jin Xu, Wenrui Liu, et al.2024 · 112 citations
- DistiLLM: Towards Streamlined Distillation for Large Language ModelsarXiv:2402.03898Jongwoo Ko, Sungnyun Kim, Tianyi Chen, et al.2024 · 112 citations
- Skywork-Reward: Bag of Tricks for Reward Modeling in LLMsarXiv:2410.18451Chris Yuhao Liu, Liang Zeng, Jiacai Liu, et al.2024 · 112 citations
- ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language ModelsarXiv:2404.07738Jinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, et al.2024 · 111 citations
- CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Quan Tu, Shilong Fan, Zihang Tian, et al.2024 · 108 citations
- Nemotron-4 340B Technical ReportarXiv:2406.11704Nvidia: Bo Adler, Niket Agarwal, Ashwath Aithal, et al.2024 · 107 citations
- Survey of Cultural Awareness in Language Models: Text and BeyondComputational LinguisticsSiddhesh Pawar, Junyeong Park, Jiho Jin, et al.2025 · 106 citations
- R-Judge: Benchmarking Safety Risk Awareness for LLM AgentsFindings of the Association for Computational LinguisticsTongxin Yuan, Zhiwei He, Lingzhong Dong, et al.2024 · 106 citations
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
- Disentangling Length from Quality in Direct Preference OptimizationFindings of the Association for Computational LinguisticsRyan Park, Rafael Rafailov, Stefano Ermon, et al.2024 · 105 citations
- WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the WildarXiv:2406.04770Bill Yuchen Lin, Yuntian Deng, Khyathi Chandu, et al.2024 · 105 citations
- Qwen2.5-1M Technical ReportarXiv:2501.15383An Yang, Bowen Yu, Chengyuan Li, et al.2025 · 102 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- A Long Way to Go: Investigating Length Correlations in RLHFarXiv:2310.03716Prasann Singhal, Tanya Goyal, Jiacheng Xu, et al.2023 · 99 citations
- MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731Ke Wang, Houxing Ren, Aojun Zhou, et al.2023 · 99 citations
- VeRA: Vector-based Random Matrix AdaptationarXiv:2310.11454Dawid J. Kopiczko, Tijmen Blankevoort, Yuki M. Asano2023 · 99 citations
- LongAlign: A Recipe for Long Context Alignment of Large Language ModelsarXiv:2401.18058Yushi Bai, Xin Lv, Jiajie Zhang, et al.2024 · 98 citations
- Fact-Checking the Output of Large Language Models via Token-Level Uncertainty QuantificationFindings of the Association for Computational LinguisticsEkaterina Fadeeva, Aleksandr Rubashevskii, Artem Shelmanov, et al.2024 · 96 citations
- MAmmoTH2: Scaling Instructions from the WebConference on Neural Information Processing Systems (NeurIPS)Xiang Yue, Tuney Zheng, Ge Zhang, et al.2024 · 96 citations
- LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive MemoryarXiv:2410.10813Di Wu, Hongwei Wang, Wenhao Yu, et al.2024 · 95 citations
- On Learning to Summarize with Large Language Models as ReferencesConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yixin Liu, Kejian Shi, Katherine He, et al.2024 · 94 citations
- WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
- SeaLLMs — Large Language Models for Southeast AsiaarXiv:2312.00738Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, et al.2023 · 92 citations
- Large Language Models are Inconsistent and Biased EvaluatorsarXiv:2405.01724Rickard Stureborg, Dimitris Alikaniotis, Yoshi Suhara2024 · 91 citations
- PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM InferenceFindings of the Association for Computational LinguisticsDongjie Yang, Xiaodong Han, Yan Gao, et al.2024 · 91 citations
- Pride and Prejudice: LLM Amplifies Self-Bias in Self-RefinementAnnual Meeting of the Association for Computational Linguistics (ACL)Wenda Xu, Guanglei Zhu, Xuandong Zhao, et al.2024 · 88 citations
- LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Adian Liusie, Potsawee Manakul, Mark Gales2024 · 87 citations
- Rethinking Interpretability in the Era of Large Language ModelsarXiv:2402.01761Chandan Singh, Jeevana Priya Inala, Michel Galley, et al.2024 · 87 citations
- Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM AssessmentConference on Empirical Methods in Natural Language Processing (EMNLP)Vyas Raina, Adian Liusie, Mark Gales2024 · 86 citations
- Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
- SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural ReasoningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Zhengyuan Liu, Xin Huang, et al.2024 · 85 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- LLMs Get Lost In Multi-Turn ConversationarXiv:2505.06120Philippe Laban, Hiroaki Hayashi, Yingbo Zhou, et al.2025 · 82 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention MapsConference on Empirical Methods in Natural Language Processing (EMNLP)Yung-Sung Chuang, Linlu Qiu, Cheng-Yu Hsieh, et al.2024 · 78 citations
- Multilingual Instruction Tuning With Just a Pinch of MultilingualityFindings of the Association for Computational LinguisticsUri Shaham, Jonathan Herzig, Roee Aharoni, et al.2024 · 78 citations
- AudioBench: A Universal Benchmark for Audio Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Xunlong Zou, Geyu Lin, et al.2025 · 77 citations
- KMMLU: Measuring Massive Multitask Language Understanding in KoreanConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guijin Son, Hanwool Lee, Sungdong Kim, et al.2025 · 76 citations
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model EvaluatorsarXiv:2403.16950Yinhong Liu, Han Zhou, Zhijiang Guo, et al.2024 · 76 citations
- Measuring Political Bias in Large Language Models: What Is Said and How It Is SaidAnnual Meeting of the Association for Computational Linguistics (ACL)Yejin Bang, Delong Chen, Nayeon Lee, et al.2024 · 76 citations
- OR-Bench: An Over-Refusal Benchmark for Large Language ModelsarXiv:2405.20947Justin Cui, Wei-Lin Chiang, Ion Stoica, et al.2024 · 76 citations
- Wider and Deeper LLM Networks are Fairer LLM EvaluatorsarXiv:2308.01862Xinghua Zhang, Bowen Yu, Haiyang Yu, et al.2023 · 75 citations
- AlignBench: Benchmarking Chinese Alignment of Large Language ModelsarXiv:2311.18743Xiao Liu, Xuanyu Lei, Shengyuan Wang, et al.2023 · 74 citations
- Black-Box Prompt Optimization: Aligning Large Language Models without Model TrainingAnnual Meeting of the Association for Computational Linguistics (ACL)Jiale Cheng, Xiao Liu, Kehan Zheng, et al.2024 · 72 citations
- HelpSteer: Multi-attribute Helpfulness Dataset for SteerLMConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zhilin Wang, Yi Dong, Jiaqi Zeng, et al.2024 · 72 citations
- VeriScore: Evaluating the factuality of verifiable claims in long-form text generationFindings of the Association for Computational LinguisticsYixiao Song, Yekyung Kim, Mohit Iyyer2024 · 72 citations
- Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-JudgeInternational Joint Conference on Natural Language Processing (IJCNLP)Lin Shi, Chiyu Ma, Wenhua Liang, et al.2025 · 71 citations
- Calibrating LLM-Based EvaluatorLanguage Resources and Evaluation Conference (LREC)Yuxuan Liu, Tianchi Yang, Shaohan Huang, et al.2024 · 71 citations
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?arXiv:2309.07462Rishav Hada, Varun Gumma, Adrian de Wynter, et al.2023 · 69 citations
- CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model GenerationarXiv:2311.18702Pei Ke, Bosi Wen, Zhuoer Feng, et al.2023 · 69 citations
- Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective RewardsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxiang Wang, Yong Lin, Wei Xiong, et al.2024 · 68 citations
- Modular Pluralism: Pluralistic Alignment via Multi-LLM CollaborationConference on Empirical Methods in Natural Language Processing (EMNLP)Shangbin Feng, Taylor Sorensen, Yuhan Liu, et al.2024 · 68 citations
- VIEScore: Towards Explainable Metrics for Conditional Image Synthesis EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Max Ku, Dongfu Jiang, Cong Wei, et al.2024 · 68 citations
- Seed1.5-VL Technical ReportarXiv:2505.07062Dong Guo, Faming Wu, Feida Zhu, et al.2025 · 67 citations
- MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Wai-Chung Kwan, Xingshan Zeng, Yuxin Jiang, et al.2024 · 67 citations
- OffsetBias: Leveraging Debiased Data for Tuning EvaluatorsFindings of the Association for Computational LinguisticsJunsoo Park, Seungyeon Jwa, Ren Meiying, et al.2024 · 67 citations
- LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMsarXiv:2408.07055Yushi Bai, Jiajie Zhang, Xin Lv, et al.2024 · 66 citations
- Inference-Time Scaling for Generalist Reward ModelingarXiv:2504.02495Zijun Liu, Peiyi Wang, Runxin Xu, et al.2025 · 65 citations
- GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken ChatbotarXiv:2412.02612Aohan Zeng, Zhengxiao Du, Mingdao Liu, et al.2024 · 65 citations
- Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-JudgeConference on Empirical Methods in Natural Language Processing (EMNLP)Tianhao Wu, Weizhe Yuan, Olga Golovneva, et al.2025 · 64 citations
- OpenMoE: An Early Effort on Open Mixture-of-Experts Language ModelsarXiv:2402.01739Fuzhao Xue, Zian Zheng, Yao Fu, et al.2024 · 64 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- OpenAgents: An Open Platform for Language Agents in the WildarXiv:2310.10634Tianbao Xie, Fan Zhou, Zhoujun Cheng, et al.2023 · 62 citations
- Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chaoqun Liu, Wenxuan Zhang, Yiran Zhao, et al.2025 · 61 citations
- One-Shot Learning as Instruction Data Prospector for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yunshui Li, Binyuan Hui, Xiaobo Xia, et al.2024 · 61 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/zheng-2023-judging-llm-judge-mt-bench/cited-by/page/2/