Botao Yu
Botao Yu has 3 papers in our library, in 2023–2024, most of them on Evaluation & benchmarks, Vision & language, Reasoning; often with Ge Zhang, Kai Zhang, Tianyu Zheng.
OpenAlex · h-index 4 · 11 works · 432 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 788 times in our library · ⭐ Paper Stars ranking: #2363
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArtificial Intelligence · 3 worksComputer Vision and Pattern Recognition · 2 worksArts and Humanities · 1 workDecision Sciences · 1 workLanguage and Linguistics · 1 workInformation Systems · 1 workInformation Systems and Management · 1 work
🧭 Topics 3Research subjects and languages the work is about.Evaluation & benchmarks · 2 worksVision & language · 2 worksReasoning · 1 work
Works by year
2020s
Papers
- MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI (2023 · 1,005 citations)
Multimodal models score very well on everyday visual benchmarks such as VQA-v2 and RefCOCO, but these tests rarely require specialist knowledge. - MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2024 · 123 citations)
MMMU is a widely used college-level benchmark of image–text questions, but some of its items can be solved without the image. Text-only LLMs succeed either because the picture is irrelevant or because they exploit cues in the answer choices. MMMU-Pro rebuilds the benchmark in three stages: - ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery (2024 · 81 citations)
Claims that LLM-based agents can automate whole research pipelines are hard to verify. The authors argue that agents should first be tested on the individual steps of a scientific workflow. For this purpose they introduce ScienceAgentBench, which collects 102 tasks from 44 peer-reviewed papers spanning four fields…
Co-authors here
- Ge Zhang ×2
- Kai Zhang ×2
- Tianyu Zheng ×2
- Xiang Yue ×2
- Yuansheng Ni ×2
- Yuxuan Sun ×2
- Boshi Wang
- Chen Wei
- Cong Wei
- Dongfu Jiang
- Huan Sun
- Samuel Stevens
Venues
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition: IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2023
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/botao-yu/