Zhenghao Lin
Zhenghao Lin has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Chen Lin, Jian Jiao, Nan Duan.
OpenAlex · ORCID · h-index 13 · 34 works · 467 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 176 times in our library · ⭐ Paper Stars ranking: #6346
Affiliations
🎓South China University of TechnologyGuangzhou ·
China2019–2026 · 10 papers🤝Shanghai Institute of Measurement and Testing TechnologyShanghai ·
China2022–2025 · 6 papers🎓Xiamen UniversityXiamen ·
China2022–2024 · 3 papers🎓Tsinghua UniversityBeijing ·
China2015–2019 · 3 papers🏥Shenzhen Third People’s HospitalShenzhen ·
China2021–2025 · 2 papers🎓Southern University of Science and TechnologyShenzhen ·
China2021–2025 · 2 papers
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators (2023 · 152 citations)
Manually labelling data for NLP is slow and expensive. This paper asks whether GPT-3.5 models can replace crowd workers. The authors build AnnoLLM, which gives the model the same materials a human annotator would get: a task description, label definitions and labelled examples. It then adds a two-stage… - Rho-1: Not All Tokens Are What You Need (2024 · 59 citations)
Standard LLM pre-training applies the next-token loss uniformly, even though filtered corpora still contain noisy, irrelevant, or already-mastered tokens.
Co-authors here
- Chen Lin ×2
- Jian Jiao ×2
- Nan Duan ×2
- Weizhu Chen ×2
- Yeyun Gong ×2
- Hang Zhang
- Ruochen Xu
- Xiao Liu
- Yelong Shen
- Yujiu Yang
- Zhibin Gou
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhenghao-lin/