Jie Ren
Jie Ren has 2 papers in our library, in 2021–2023, most of them on Language models & pretraining; often with Charles Sutton, Denny Zhou, Minjia Zhang.
OpenAlex · ORCID · h-index 3 · 12 works · 23 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 323 times in our library · ⭐ Paper Stars ranking: #3798
Affiliations
Concepts, shelves and topics
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksHardware and Architecture · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- ZeRO-Offload: Democratizing Billion-Scale Model Training (2021 · 303 citations)
Training models with billions of parameters usually needs many GPUs, because existing parallel methods only work when the combined GPU memory can hold the parameters, gradients and optimizer states. - Universal Self-Consistency for Large Language Model Generation (2023 · 86 citations)
Standard self-consistency samples several chain-of-thought solutions and takes a majority vote over the final answers.
Co-authors here
- Charles Sutton
- Denny Zhou
- Minjia Zhang
- Pengcheng Yin
- Reza Yazdani Aminabadi
- Samyam Rajbhandari
- Uri Alon
- Xinyun Chen
- Xuezhi Wang
- Yuxiong He
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jie-ren/