Jiacai Liu
Jiacai Liu has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining; often with Chaojie Wang, Chris Yuhao Liu, Jujie He.
OpenAlex · h-index 1 · 7 works · 2 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 158 times in our library · ⭐ Paper Stars ranking: #6080
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 workSafety Research · 1 workSocial Sciences · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs (2024 · 112 citations)
Reward models turn human preferences into a training signal for LLM alignment. Their quality depends heavily on the preference data, and open-source preference datasets tend to be noisy or inconsistently labelled. The authors take a data-first approach. Using only public sources (HelpSteer2, OffsetBias, WildGuardMix… - Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergy (2025 · 48 citations)
Open reward models used in RLHF are fragile. High RewardBench scores often fail to carry over to other evaluations, and tweaks to losses or architectures have brought little real progress. The authors argue that the bottleneck is the preference data itself, which is often narrow, synthetically labeled or poorly…
Co-authors here
- Chaojie Wang ×2
- Chris Yuhao Liu ×2
- Jujie He ×2
- Liang Zeng ×2
- Rui Yan ×2
- Yahui Zhou ×2
- Yang Liu ×2
- Jiacheng Xu
- Shuicheng Yan
- Wei Shen
- Yuzhen Xiao
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jiacai-liu/