Zijun Yao
Zijun Yao has 6 papers in our library, in 2024–2026, most of them on Language models & pretraining, Information retrieval & search, Efficient models & compression; often with Juanzi Li, Lei Hou, Hao Peng.
OpenAlex · ORCID · Wikidata · h-index 10 · 60 works · 324 citations OpenAlex, 2026-10-14
📄 6 works in our library · 🔗 Cited 138 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6343
Affiliations
Fields, topics and concepts
📚 Shelves 12The field of science this work belongs to (OpenAlex fields).Computer Science · 6 worksArtificial Intelligence · 6 worksArts and Humanities · 4 worksLanguage and Linguistics · 4 worksInformation Systems · 1 workSafety Research · 1 workSocial Sciences · 1 workComputer Vision and Pattern Recognition · 1 workHealth Informatics · 1 workHealth Information Management · 1 workHealth Professions · 1 workMedicine · 1 work
🧭 Topics 3Research subjects and languages the work is about.Information retrieval & search · 1 workEfficient models & compression · 1 workLanguage models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Inverted index · 1 work
Works by year
2020s
Papers
- RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style (2024 · 53 citations)
Reward models steer RLHF training and choose the best candidate output in inference-time scaling, yet existing benchmarks usually pit a strong model's answer against a weaker model's answer. - SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation (2025 · 52 citations)
Adaptive retrieval-augmented generation (RAG) aims to query a search engine only when a large language model actually lacks the knowledge it needs. - Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems (2025 · 18 citations)
Reward models for LLMs are usually trained only on human preferences. They can favour superficial traits such as longer or more polished answers and miss factual mistakes or ignored constraints. The authors propose agentic reward modeling, in which the final reward is a weighted combination of a base preference score… - Pre-training Distillation for Large Language Models: A Design Space Exploration (2025 · 14 citations)
Knowledge distillation for large language models is usually applied after pre-training, when a student is fine-tuned on responses written by a stronger teacher. - RePrompT: Recurrent Prompt Tuning for Integrating Structured EHR Encoders with Large Language Models (2026)
When LLMs are applied to structured electronic health records, two weaknesses appear. Converting visit sequences into flat text blurs the timing between visits and the identity of individual codes. Each patient is also handled on its own, so the model gains nothing from patterns that recur across the cohort. - WildReward: Learning Reward Models from In-the-Wild Human Interactions (2026)
Reward models for LLM training usually depend on large sets of human-annotated preference pairs, which are expensive to collect.
All works
- RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and StylearXiv:2410.16184Yantao Liu, Zijun Yao, Rui Min, et al.2024 · 53 citations
- SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Zijun Yao, Weijian Qi, Liangming Pan, et al.2025 · 52 citations
- T1: Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling ↗arXiv:2501.11651 · no summary yetZhenyu Hou et al.2025 · 28 citations
- Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward SystemsAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Peng, Yunjia Qi, Xiaozhi Wang, et al.2025 · 18 citations
- Pre-training Distillation for Large Language Models: A Design Space ExplorationAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Peng, Xin Lv, Yushi Bai, et al.2025 · 14 citations
- RePrompT: Recurrent Prompt Tuning for Integrating Structured EHR Encoders with Large Language ModelsFindings of the Association for Computational LinguisticsArya Hadizadeh Moghaddam, Drew Ross, Mohsen Nayebi Kerdabadi, et al.2026
- WildReward: Learning Reward Models from In-the-Wild Human InteractionsAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Peng, Yunjia Qi, Xiaozhi Wang, et al.2026
Co-authors here
- Juanzi Li ×5
- Lei Hou ×5
- Hao Peng ×3
- Xiaozhi Wang ×2
- Yunjia Qi ×2
- Bin Xu
- Dongjie Wang
- Jiajie Zhang
- Liangming Pan
- Shulin Cao
- Xin Lv
- Yantao Liu
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×4: ACL 2026, ACL 2025 ×3
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zijun-yao/