Nan Jiang
Nan Jiang has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Hanze Dong, Heng Ji, Tong Zhang.
OpenAlex · ORCID · h-index 15 · 88 works · 796 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 237 times in our library · ⭐ Paper Stars ranking: #5885
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksComputer Science · 3 worksArts and Humanities · 2 worksLanguage and Linguistics · 2 worksDecision Sciences · 1 workManagement Science and Operations Research · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- RLHF Workflow: From Reward Modeling to Online RLHF (2024 · 111 citations)
Online iterative RLHF has been reported to clearly beat offline alignment, yet open-source alignment work mostly stays offline. - Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint (2023 · 100 citations)
Popular RLHF methods such as offline PPO and offline DPO learn from one fixed preference dataset. To reach the optimal policy, that dataset would need to cover almost the entire prompt–response space, which is unrealistic given how vast the space of possible responses is. The authors cast alignment as a reverse-KL… - Word Embeddings Are Steers for Language Models (2024 · 49 citations)
The paper asks what role output word embeddings play in how language models generate text, a question earlier work has mostly treated only at the level of individual word meaning.
Co-authors here
- Hanze Dong ×2
- Heng Ji ×2
- Tong Zhang ×2
- Wei Xiong ×2
- Bo Pang
- Caiming Xiong
- Chenkai Sun
- Chi Han
- Doyen Sahoo
- Han Zhao
- Haoxiang Wang
- Manling Li
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/nan-jiang/