Banghua Zhu
Banghua Zhu has 2 papers in our library, in 2024, most of them on Evaluation & benchmarks, Language models & pretraining, Dialogue systems; often with Ion Gabriel Stoica, Joseph E. Gonzalez, Tianle Li.
OpenAlex · ORCID · h-index 12 · 44 works · 509 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 822 times in our library · 8 more in our library without a page yet · ⭐ Paper Stars ranking: #2964
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Networks and Communications · 1 workInformation Systems · 1 work
🧭 Topics 3Research subjects and languages the work is about.Evaluation & benchmarks · 2 worksDialogue systems · 1 workLanguage models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Chatbots · 1 work
Works by year
2020s
Papers
- Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference (2024 · 546 citations)
The authors show that conventional LLM benchmarks poorly reflect how models are actually used. These are fixed sets of closed-ended questions with reference answers: over time they leak into training data, become saturated, and do not account for human preferences in open-ended tasks. As an alternative, they propose… - From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline (2024 · 210 citations)
Static LLM benchmarks saturate quickly, can leak into training data, and mostly test close-ended tasks. Expert-built sets are expensive: GPQA's 500 questions reportedly cost over $120,000. Live human evaluation such as Chatbot Arena is too slow for developers to use routinely. The authors present BenchBuilder, an…
All works
- Chatbot Arena: An Open Platform for Evaluating LLMs by Human PreferencearXiv:2403.04132Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, et al.2024 · 546 citations
- From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder PipelinearXiv:2406.11939Tianle Li, Wei-Lin Chiang, Evan Frick, et al.2024 · 210 citations
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters ↗MLSys 2024 · no summary yetYing Sheng et al.2023 · 80 citations
- Fairness in Serving Large Language Models ↗arXiv (Cornell University) · no summary yetYing Sheng et al.2023 · 62 citations
- Generalized resilience and robust statistics ↗The Annals of Statistics · no summary yetBanghua Zhu, Jiantao Jiao, Jacob Steinhardt2019 · 34 citations
- How to Evaluate Reward Models for RLHF ↗arXiv:2410.14872 · no summary yetEvan Frick et al.2024 · 31 citations
- Robust estimation via generalized quasi-gradients ↗Information and Inference A Journal of the IMA · no summary yetBanghua Zhu, Jiantao Jiao, Jacob Steinhardt2021 · 22 citations
- When does the Tukey Median work? ↗IEEE International Symposium on Information Theory (ISIT) · no summary yetBanghua Zhu, Jiantao Jiao, Jacob Steinhardt2020 · 16 citations
- On Optimal Caching and Model Multiplexing for Large Model Inference ↗arXiv (Cornell University) · no summary yetBanghua Zhu et al.2023 · 5 citations
- Byzantine-Robust Federated Learning with Optimal Statistical Rates and Privacy Guarantees ↗arXiv (Cornell University) · no summary yetBanghua Zhu et al.2022 · 1 citation
Co-authors here
- Ion Gabriel Stoica ×2
- Joseph E. Gonzalez ×2
- Tianle Li ×2
- Wei-Lin Chiang ×2
- Dacheng Li
- Hao Zhang
- Lianmin Zheng
- Michael I. Jordan
- Tianhao Wu
- Ying Sheng
Venues
- IEEE International Symposium on Information Theory (ISIT)
- Information and Inference A Journal of the IMA
- MLSys 2024
- The Annals of Statistics
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/banghua-zhu/