Zhichao Shi
Zhichao Shi has 3 papers in our library, in 2026, most of them on Evaluation & benchmarks, Language models & pretraining, Multilingual & cross-lingual NLP; often with Chengjin Xu, Jian Guo, Xuhui Jiang.
OpenAlex · h-index 0 · 3 works · 0 citations OpenAlex, 2026-10-14
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 2 worksComputer Networks and Communications · 1 work
🧭 Topics 4Research subjects and languages the work is about.Evaluation & benchmarks · 2 worksLanguage models & pretraining · 1 workMultilingual & cross-lingual NLP · 1 workVision & language · 1 work
Works by year
2020s
Papers
- DataArc-SynData-Toolkit: A Unified Closed-Loop Framework for Multi-Path, Multimodal, and Multilingual Data Synthesis (2026)
Synthetic data can ease data shortages for LLMs in specialised domains and low-resource languages, but current tools tend to be hard for non-experts, rely on inconsistent data formats, and handle extra modalities or languages poorly. - JudgeAgent: Beyond Static Benchmarks for Knowledge-Driven and Dynamic LLM Evaluation (2026)
Static benchmarks for LLMs saturate quickly, cover a fixed slice of knowledge, risk contamination, and pose questions whose difficulty may not suit the model under test. - ROSE: An Intent-Centered Evaluation Metric for NL2SQL (2026)
The paper argues that Execution Accuracy (EX), the standard NL2SQL metric, gives misleading scores. EX only checks whether a predicted query returns the same result as one reference SQL. It therefore fails in three situations: correct queries with different output formatting or column order, valid alternative…
Co-authors here
- Chengjin Xu ×2
- Jian Guo ×2
- Xuhui Jiang ×2
- Yuanzhuo Wang ×2
- Boyan Li
- Cehao Yang
- Hao Zhou
- Shengjie Ma
- Xiaojun Wu
- Yuyu Luo
- Zixuan Li
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2026 ×2
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhichao-shi/