Gerald Shen
Gerald Shen has 2 papers in our library, in 2024, most of them on Language models & pretraining, Efficient models & compression; often with Jiaqi Zeng, Ameya Sunil Mahabaleshwarkar, Daniel Egert.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 123 times in our library · ⭐ Paper Stars ranking: #7482
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 1 workComputer Science · 1 workArtificial Intelligence · 1 workComputer Vision and Pattern Recognition · 1 workLanguage and Linguistics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- HelpSteer2: Open-source dataset for training top-performing reward models (2024 · 82 citations)
Reward models that steer LLMs toward human-preferred outputs need good preference data. Openly licensed collections such as HH-RLHF, Open Assistant and HelpSteer have aged, and sets distilled from GPT-4 and similar proprietary systems carry commercial-use restrictions. The NVIDIA authors address this gap with… - LLM Pruning and Distillation in Practice: The Minitron Approach (2024 · 44 citations)
Minitron-style compression trains only the largest model in a family and derives smaller ones by structured pruning followed by knowledge distillation.
Co-authors here
- Jiaqi Zeng ×2
- Ameya Sunil Mahabaleshwarkar
- Daniel Egert
- Makesh Narsimhan Sreedhar
- Oleksii Kuchaiev
- Olivier Delalleau
- Saurav Muralidharan
- Shizhe Diao
- Yi Dong
- Yoshi Suhara
- Zhilin Wang
- Zijia Chen
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/gerald-shen/