Xuan He
Xuan He has 2 papers in our library, in 2024, most of them on Language models & pretraining, Evaluation & benchmarks; often with Max Ku, Cong Wei, Dongfu Jiang.
OpenAlex · ORCID · h-index 12 · 33 works · 502 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 711 times in our library · ⭐ Paper Stars ranking: #3061
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 worksMathematics · 1 work
🧭 Topics 3Research subjects and languages the work is about.Evaluation & benchmarks · 1 workReasoning · 1 workLanguage models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Natural language understanding · 1 work
Works by year
2020s
Papers
- MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark (2024 · 761 citations)
MMLU had become saturated as a benchmark. Frontier LLMs all clustered around 86–87%, scores shifted noticeably when the prompt changed, and part of the data was noisy or wrongly labelled. The authors built MMLU-Pro to give the field a harder test that separates models better. - MANTIS: Interleaved Multi-Image Instruction Tuning (2024 · 74 citations)
Most open large multimodal models (LMMs) handle one image well but struggle when a task involves several images.
Co-authors here
- Max Ku ×2
- Cong Wei
- Dongfu Jiang
- Ge Zhang
- Qian Liu
- Tianle Li
- Weiming Ren
- Wenhu Chen
- Xueguang Ma
- Yuansheng Ni
- Yubo Wang
Venues
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
- Transactions on Machine Learning Research: Transactions on Machine Learning Research 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/xuan-he/