🔗 Who cites «Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference»

446 papers of our library cite it (of the 149,439 whose bibliographies we read) · 97 with a page here, the most cited first · ← back to «Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference»

1. The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
2. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement LearningNatureDeepSeek-AI, Daya Guo, Dejian Yang, et al.2025 · 4,728 citations
3. Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesarXiv:2507.06261Gheorghe Comanici, Eric Bieber, Mike Schaekermann, et al.2025 · 974 citations
4. MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding BenchmarkConference on Neural Information Processing Systems (NeurIPS)Yubo Wang, Xueguang Ma, Ge Zhang, et al.2024 · 761 citations
5. SGLang: Efficient Execution of Structured Language Model ProgramsConference on Neural Information Processing Systems (NeurIPS)Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, et al.2023 · 729 citations
6. Qwen2.5-Coder Technical ReportarXiv:2409.12186Binyuan Hui, Jian Yang, Zeyu Cui, et al.2024 · 559 citations
7. SWE-agent: Agent-Computer Interfaces Enable Automated Software EngineeringConference on Neural Information Processing Systems (NeurIPS)John Yang, Carlos E. Jimenez, Alexander Wettig, et al.2024 · 552 citations
8. Phi-4 Technical ReportarXiv:2412.08905Marah Abdin, Jyoti Aneja, Harkirat Behl, et al.2024 · 502 citations
9. Tulu 3: Pushing Frontiers in Open Language Model Post-TrainingarXiv:2411.15124Nathan Lambert, Jacob Morrison, Valentina Pyatkin, et al.2024 · 423 citations
10. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
11. From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder PipelinearXiv:2406.11939Tianle Li, Wei-Lin Chiang, Evan Frick, et al.2024 · 210 citations
12. Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Shengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 208 citations
13. Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language ModelsarXiv:2410.07985Bofei Gao, Feifan Song, Zhe Yang, et al.2024 · 163 citations
14. LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation TasksarXiv:2406.18403Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, et al.2024 · 141 citations
15. LMMs-Eval: Reality Check on the Evaluation of Large Multimodal ModelsFindings of the Association for Computational LinguisticsKaichen Zhang, Bo Li, Peiyuan Zhang, et al.2025 · 115 citations
16. WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the WildarXiv:2406.04770Bill Yuchen Lin, Yuntian Deng, Khyathi Chandu, et al.2024 · 105 citations
17. LLMs Get Lost In Multi-Turn ConversationarXiv:2505.06120Philippe Laban, Hiroaki Hayashi, Yingbo Zhou, et al.2025 · 82 citations
18. AudioBench: A Universal Benchmark for Audio Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Xunlong Zou, Geyu Lin, et al.2025 · 77 citations
19. KMMLU: Measuring Massive Multitask Language Understanding in KoreanConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guijin Son, Hanwool Lee, Sungdong Kim, et al.2025 · 76 citations
20. MagicPIG: LSH Sampling for Efficient LLM GenerationarXiv:2410.16179Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.2024 · 68 citations
21. RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and StylearXiv:2410.16184Yantao Liu, Zijun Yao, Rui Min, et al.2024 · 53 citations
22. Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference FeedbackConference on Neural Information Processing Systems (NeurIPS)Hamish Ivison, Yizhong Wang, Jiacheng Liu, et al.2024 · 50 citations
23. MixEval: Deriving Wisdom of the Crowd from LLM Benchmark MixturesConference on Neural Information Processing Systems (NeurIPS)Jinjie Ni, Fuzhao Xue, Xiang Yue, et al.2024 · 47 citations
24. FollowIR: Evaluating and Teaching Information Retrieval Models to Follow InstructionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Orion Weller, Benjamin Chang, Sean MacAvaney, et al.2025 · 40 citations
25. Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
26. CulturalBench: A Robust, Diverse and Challenging Benchmark for Measuring LMs' Cultural Knowledge Through Human-AI Red-TeamingAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Ying Chiu, Liwei Jiang, Bill Yuchen Lin, et al.2025 · 38 citations
27. SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model SafetyarXiv:2404.05399Paul Rottger, Fabio Pernisi, Bertie Vidgen, et al.2024 · 33 citations
28. Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
29. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic ReasoningarXiv:2512.20848NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, et al.2025 · 27 citations
30. LLM-as-a-Judge & Reward Model: What They Can and Cannot DoarXiv:2409.11239Guijin Son, Hyunwoo Ko, Hoyoung Lee, et al.2024 · 27 citations
31. Language Model Alignment in Multilingual Trolley ProblemsarXiv:2407.02273Zhijing Jin, Max Kleiman-Weiner, Giorgio Piatti, et al.2024 · 23 citations
32. Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-GenerationarXiv:2410.02725Rohin Manvi, Anikait Singh, Stefano Ermon2024 · 22 citations
33. “Give Me BF16 or Give Me Death”? Accuracy-Performance Trade-Offs in LLM QuantizationAnnual Meeting of the Association for Computational Linguistics (ACL)Eldar Kurtic, Alexandre Noll Marques, Shubhra Pandit, et al.2025 · 21 citations
34. Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in AlignmentTransactions of the Association for Computational Linguistics (TACL)Karel D'Oosterlinck, Winnie Xu, Chris Develder, et al.2025 · 20 citations
35. CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and AugmentationTransactions of the Association for Computational Linguistics (TACL)Ingo Ziegler, Abdullatif Köksal, Desmond Elliott, et al.2025 · 20 citations
36. GameBench: Evaluating Strategic Reasoning Abilities of LLM AgentsarXiv:2406.06613Anthony Costarelli, Mat Allen, Roman Hauksson, et al.2024 · 20 citations
37. Navigating Rifts in Human-LLM Grounding: Study and BenchmarkAnnual Meeting of the Association for Computational Linguistics (ACL)Omar Shaikh, Hussein Mozannar, Gagan Bansal, et al.2025 · 19 citations
38. sDPO: Don't Use Your Data All at OncearXiv:2403.19270Dahyun Kim, Yungi Kim, Wonho Song, et al.2024 · 19 citations
39. Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language modelsarXiv:2405.02287Piotr Padlewski, Max Bain, Matthew Henderson, et al.2024 · 19 citations
40. Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Chih-Kai Yang, Neo S. Ho, Hung-yi Lee2025 · 17 citations
41. MultiPragEval: Multilingual Pragmatic Evaluation of Large Language ModelsProceedings of the 2nd GenBench Workshop on Generalisation (Benchmarking) in NLPDojun Park, Jiwoo Lee, Seohyun Park, et al.2024 · 17 citations
42. Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy DistillationarXiv:2603.19220Zhuolin Yang, Zihan Liu, Yang Chen, et al.2026 · 16 citations
43. Auto-Arena: Automating LLM Evaluations with Agent Peer Battles and Committee DiscussionsAnnual Meeting of the Association for Computational Linguistics (ACL)Ruochen Zhao, Wenxuan Zhang, Yew Ken Chia, et al.2025 · 16 citations
44. JuStRank: Benchmarking LLM Judges for System RankingAnnual Meeting of the Association for Computational Linguistics (ACL)Ariel Gera, Odellia Boni, Yotam Perlitz, et al.2025 · 15 citations
45. MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation SystemsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Nandan Thakur, Suleman Kazi, Ge Luo, et al.2025 · 15 citations
46. When One LLM Drools, Multi-LLM Collaboration RulesAnnual Meeting of the Association for Computational Linguistics (ACL)Shangbin Feng, Wenxuan Ding, Alisa Liu, et al.2026 · 14 citations
47. BALSAM: A Platform for Benchmarking Arabic Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Rawan Al-Matham, Kareem Darwish, Raghad Al-Rasheed, et al.2025 · 14 citations
48. MTSA: Multi-turn Safety Alignment for LLMs through Multi-round Red-teamingAnnual Meeting of the Association for Computational Linguistics (ACL)Weiyang Guo, Jing Li, Wenya Wang, et al.2025 · 14 citations
49. TripleFact: Defending Data Contamination in the Evaluation of LLM-driven Fake News DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Cheng Xu, Nan Yan2025 · 12 citations
50. SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded TasksConference on Neural Information Processing Systems (NeurIPS)Yilun Zhao, Kaiyan Zhang, Tiansheng Hu, et al.2025 · 11 citations
51. Beyond the Surface: Measuring Self-Preference in LLM JudgmentsConference on Empirical Methods in Natural Language Processing (EMNLP)Zhi-Yuan Chen, Hao Wang, Xinyu Zhang, et al.2025 · 10 citations
52. Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-ThoughtarXiv:2505.15431Tencent Hunyuan Team, Ao Liu, Botong Zhou, et al.2025 · 10 citations
53. Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMsInternational Conference on Computational Linguistics (COLING)Tamzeed Mahfuz, Satak Kumar Dey, Ruwad Naswan, et al.2025 · 10 citations
54. ChatBench: From Static Benchmarks to Human-AI EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Serina Chang, Ashton Anderson, Jake M. Hofman2025 · 9 citations
55. MetaScale: Test-Time Scaling with Evolving Meta-ThoughtsFindings of the Association for Computational LinguisticsQin Liu, Wenxuan Zhou, Nan Xu, et al.2026 · 7 citations
56. Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language ModelsFindings of the Association for Computational LinguisticsBang Zhang, Ruotian Ma, Qingxuan Jiang, et al.2026 · 6 citations
57. mR3: Multilingual Rubric-Agnostic Reward Reasoning ModelsarXiv:2510.01146David Anugraha, Shou-Yi Hung, Zilu Tang, et al.2025 · 5 citations
58. GemmAr: Enhancing LLMs Through Arabic Instruction-TuningarXiv:2407.02147Hasna Chouikhi, Manel Aloui, Cyrine Ben Hammou, et al.2024 · 4 citations
59. How Long Reasoning Chains Influence LLMs' Judgment of Answer FactualityAnnual Meeting of the Association for Computational Linguistics (ACL)Minzhu Tu, Shiyu Ni, Keping Bi2026 · 3 citations
60. LLMEval-Fair: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Ming Zhang, Yujiong Shen, Jingyi Deng, et al.2026 · 3 citations
61. My LLM might Mimic AAE - But When Should It?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sandra Camille Sandoval, Christabel Acquaye, Kwesi Adu Cobbina, et al.2025 · 3 citations
62. EvoRoute: Experience-Driven Self-Routing LLM Agent SystemsAnnual Meeting of the Association for Computational Linguistics (ACL)Guibin Zhang, Haiyang Yu, Kaiming Yang, et al.2026 · 2 citations
63. Paragraph Segmentation Revisited: Towards a Standard Task for Structuring SpeechLanguage Resources and Evaluation Conference (LREC)Fabian Retkowski, Alexander Waibel2026 · 2 citations
64. Position: LLM Watermarking Should Align Stakeholders' Incentives for Practical AdoptionFindings of the Association for Computational LinguisticsYepeng Liu, Xuandong Zhao, Dawn Song, et al.2026 · 2 citations
65. STEP3-VL-10B Technical ReportarXiv:2601.09668Ailin Huang, Chengyuan Yao, Chunrui Han, et al.2026 · 2 citations
66. Tracking the evolution of LLM capabilities for Belarusian with OpenAI EvalsWorkshop on Language Models for Low-Resource LanguagesVladislav Poritski, Oksana Volchek, Maksim Aparovich, et al.2026 · 2 citations
67. WASIL: In-the-Wild Arabic Spoken Interactions with LLMsarXiv:2605.16364Zien Sheikh Ali, Hamdy Mubarak, Soon-Gyo Jung, et al.2026 · 2 citations
68. Methodology of Adapting Large English Language Models for Specific Cultural ContextsarXiv:2406.18192Wenjing Zhang, Siqi Xiao, Xuejiao Lei, et al.2024 · 2 citations
69. Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the FutureAnnual Meeting of the Association for Computational Linguistics (ACL)Sihong Wu, Owen Jiang, Yilun Zhao, et al.2026 · 1 citation
70. Can Models Help Us Create Better Models? Evaluating LLMs as Data ScientistsFindings of the Association for Computational LinguisticsMichał Pietruszka, Łukasz Borchmann, Aleksander Jędrosz, et al.2026 · 1 citation
71. Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yanbin Yin, Kun Zhou, Zhen Wang, et al.2026 · 1 citation
72. Frankentext: Stitching random text fragments into long-form narrativesAnnual Meeting of the Association for Computational Linguistics (ACL)Chau Minh Pham, Jenna Russell, Dzung Pham, et al.2026 · 1 citation
73. IGenBench: Benchmarking the Reliability of Text-to-Infographic GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Yinghao Tang, Xueding Liu, Boyuan Zhang, et al.2026 · 1 citation
74. Measuring Human Contribution in AI-Assisted Content GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Yueqi Xie, Tao Qi, Jingwei Yi, et al.2026 · 1 citation
75. Multi-modal, Multi-task, Multi-criteria Automatic Evaluation with Vision Language ModelsLanguage Resources and Evaluation Conference (LREC)Masanari Oi, Masahiro Kaneko, Naoaki Okazaki, et al.2026 · 1 citation
76. P-Check: Advancing Personalized Reward Model via Learning to Generate Dynamic ChecklistAnnual Meeting of the Association for Computational Linguistics (ACL)Kwangwook Seo, Dongha Lee2026 · 1 citation
77. SCAN: Structured Capability Assessment and Navigation for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Zongqi Wang, Tianle Gu, Chen Gong, et al.2026 · 1 citation
78. X-NLP at SemEval-2026 Task 12: Prompting LLMs for Abductive Event ReasoningInternational Workshop on Semantic Evaluation (SemEval)Caelen Mattie, Patrick Bowen, Milton King2026 · 1 citation
79. AI Safety Lost in Translation: Evaluating the Effectiveness of English-Italian Cross-Lingual LLM Safety AlignmentLanguage Resources and Evaluation Conference (LREC)Alessio Wu, Martim Brandao2026
80. At Your Own PACE: A Causal Framework for Evaluating EQ in LLMsFindings of the Association for Computational LinguisticsLei Lyu, Shengling Wang, Ke Chao, et al.2026
81. Automatic Evaluation of Open-Domain Real Conversations: Combining Encoder-Based, Dialogue-Based Features and Large Language Models RatingsInternational Workshop on Spoken Dialogue System TechnologyCristina Conforto-López, Marcos Estecha-Garitagoitia, Mario Rodriguez-Cantelar, et al.2026
82. AutoTaskEval: Towards Domain-Specific and Fine-Grained Evaluation for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Qingqing Lyu, Linjuan Wu, Yongliang Shen, et al.2026
83. Calibrating LLM Judges: Linear Probes for Fast and Reliable Uncertainty EstimationAnnual Meeting of the Association for Computational Linguistics (ACL)Bhaktipriya Radharapu, Eshika Saxena, Kenneth Li, et al.2026
84. Can AI Revise Research Papers with Human Review Feedback? An Empirical Study and BenchmarkFindings of the Association for Computational LinguisticsZihan Luo, Hong Huang, Jianxun Lian, et al.2026
85. ClinAlign: Scaling Healthcare Alignment from Clinician PreferenceFindings of the Association for Computational LinguisticsShiwei Lyu, Xidong Wang, Hao Zhu, et al.2026
86. Confident, Calibrated, or Complicit: Safety Alignment and Ideological Bias in LLM Hate Speech DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Sanjeevan Selvaganapathy, Mehwish Nasim2026
87. Evaluating Cost-Efficiency of LLMs in a RAG Setup on Polish Wikipedia: Quality vs. Energy ConsumptionConference of the European Chapter of the Association for Computational Linguistics (EACL)Patrycja Smits, Tomasz Walkowiak2026
88. ExpressivityBench: Can LLMs Communicate Implicitly?Findings of the Association for Computational LinguisticsJoshua Tint, Som Sagar, Aditya Taparia, et al.2026
89. Feedback-Aware Prompt Optimization Framework for Generating Job PostingsConference of the European Chapter of the Association for Computational Linguistics (EACL)Suraj Maharjan, Ainur Yessenalina, Srinivasan H. Sengamedu2026
90. Model Directions, Not Words: Mechanistic Topic Models Using Sparse AutoencodersTransactions of the Association for Computational Linguistics (TACL)Carolina Zheng, Nicolas Beltran-Velez, Sweta Karlekar, et al.2026
91. MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval BenchmarksAnnual Meeting of the Association for Computational Linguistics (ACL)Junhao Ruan, Abudukeyumu Abudula, Bei Li, et al.2026
92. Probing the Plasticity and Correlation of LLM Value Systems: LLM Value Rankings are Not StableFindings of the Association for Computational LinguisticsZhenheng Tang, Qihua Pan, Jingya Shen, et al.2026
93. Russian Generative Spelling, Punctuation and Capitalization CorrectionLanguage Resources and Evaluation Conference (LREC)Nikita Martynov, Danil Astafurov, Ulyana Isaeva, et al.2026
94. SEMIROUTER: Sparse-Data Enhanced Routing for Adaptive Multi-LLM SystemConference of the European Chapter of the Association for Computational Linguistics (EACL)Zijie Wang, Xinyu Yan, Che Wang, et al.2026
95. Synthetic Instruction Generation for Low-Resource Nordic Languages: Viability and Limitations in LLM Instruction-TuningLanguage Resources and Evaluation Conference (LREC)Mathias Stenlund, Annika Simonsen, Lars Bungum, et al.2026
96. Toying with Style: Can GenAI Mimic a Literary Translator's Voice?Workshop on Style in GenAI-Translated Content (StyGenAI)Beniamin Sopot, Dorothy Kenny2026
97. WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation MetricsAnnual Meeting of the Association for Computational Linguistics (ACL)Chenxu Liu, Yingjie Fu, Wei Yang, et al.2026

349 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/chiang-2024-chatbot-arena-open-platform-evaluating/cited-by/