Hangyu Lin
Hangyu Lin has 2 papers in our library, in 2024, most of them on Multilingual & cross-lingual NLP; often with Bharat Venkitesh, Hanze Dong, Haoxiang Wang.
OpenAlex · ORCID · h-index 11 · 45 works · 455 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 393 times in our library · ⭐ Paper Stars ranking: #4409
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Multilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- Aya 23: Open Weight Releases to Further Multilingual Progress (2024 · 171 citations)
Aya 23 addresses a weakness of massively multilingual models. When one model covers about a hundred languages, each language gets only a small share of its capacity (the "curse of multilinguality"). Aya 101 also relied on the aging mT5 base. Cohere For AI instead concentrated on 23 languages, including Ukrainian… - Mitigating the Alignment Tax of RLHF (2024 · 82 citations)
RLHF makes LLMs follow human preferences, but it also tends to erode skills learned in pre-training. This loss is called the alignment tax. The authors measured it by aligning OpenLLaMA-3B on the Anthropic helpfulness/harmlessness data with Rejection Sampling Fine-tuning (RSF) and DPO. They then tracked performance…
Co-authors here
- Bharat Venkitesh
- Hanze Dong
- Haoxiang Wang
- Jipeng Zhang
- John Dang
- Kelly Marchisio
- Madeline Smith
- Max Bartolo
- Rui Pan
- Shizhe Diao
- Viraat Aryabumi
- Wei Xiong
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/hangyu-lin/