Haoxiang Wang
Haoxiang Wang has 3 papers in our library, in 2024, most of them on Language models & pretraining; often with Wei Xiong, Han Zhao, Shizhe Diao.
OpenAlex · ORCID · Wikidata · h-index 47 · 524 works · 12,118 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 340 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #4237
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts (2024 · 142 citations)
Reward models (RMs) in RLHF usually learn from binary pairwise preferences with a Bradley-Terry objective. - Mitigating the Alignment Tax of RLHF (2024 · 82 citations)
RLHF makes LLMs follow human preferences, but it also tends to erode skills learned in pre-training. This loss is called the alignment tax. The authors measured it by aligning OpenLLaMA-3B on the Anthropic helpfulness/harmlessness data with Rejection Sampling Fine-tuning (RSF) and DPO. They then tracked performance… - Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards (2024 · 66 citations)
Standard RLHF compresses human judgments into one scalar reward. This pushes a model toward an "average user" and ignores people whose tastes conflict, such as those who want useful but short answers. The authors propose Directional Preference Alignment (DPA) to address this.
All works
- Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-ExpertsFindings of the Association for Computational LinguisticsHaoxiang Wang, Wei Xiong, Tengyang Xie, et al.2024 · 142 citations
- RLHF Workflow: From Reward Modeling to Online RLHFarXiv:2405.07863 · original ↗ · no summary yetHanze Dong et al.2024 · 106 citations
- Mitigating the Alignment Tax of RLHFConference on Empirical Methods in Natural Language Processing (EMNLP)Yong Lin, Hangyu Lin, Wei Xiong, et al.2024 · 82 citations
- Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective RewardsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxiang Wang, Yong Lin, Wei Xiong, et al.2024 · 66 citations
Co-authors here
- Wei Xiong ×3
- Han Zhao ×2
- Shizhe Diao ×2
- Tong Zhang ×2
- Yong Lin ×2
- Hangyu Lin
- Hanze Dong
- Jipeng Zhang
- Rui Pan
- Rui Yang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2024
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2024
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/haoxiang-wang/