Yong Lin
Yong Lin has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Haoxiang Wang, Shizhe Diao, Wei Xiong.
OpenAlex · h-index 1 · 3 works · 7 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 113 times in our library · ⭐ Paper Stars ranking: #4869
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Mitigating the Alignment Tax of RLHF (2024 · 82 citations)
RLHF makes LLMs follow human preferences, but it also tends to erode skills learned in pre-training. This loss is called the alignment tax. The authors measured it by aligning OpenLLaMA-3B on the Anthropic helpfulness/harmlessness data with Rejection Sampling Fine-tuning (RSF) and DPO. They then tracked performance… - Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards (2024 · 66 citations)
Standard RLHF compresses human judgments into one scalar reward. This pushes a model toward an "average user" and ignores people whose tastes conflict, such as those who want useful but short answers. The authors propose Directional Preference Alignment (DPA) to address this.
Co-authors here
- Haoxiang Wang ×2
- Shizhe Diao ×2
- Wei Xiong ×2
- Han Zhao
- Hangyu Lin
- Hanze Dong
- Jipeng Zhang
- Rui Pan
- Rui Yang
- Tong Zhang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2024
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yong-lin/