Elamur Research⌕
☰
home / authors / Olatunji Ruwase

Olatunji Ruwase

Olatunji Ruwase has 2 papers in our library, in 2021, most of them on GPU & parallel computing; often with Samyam Rajbhandari, Yuxiong He, Dong Li.

2 papers in our library · 2021

OpenAlex · ORCID · Wikidata · h-index 22 · 72 works · 4,916 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 2,743 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #3972

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🏢Snowflake Inc.Bozeman · United States2025–2026 · 4 paperscurrent🎓Bellevue CollegeBellevue · United States2026 · 1 papercurrent🏥Overlake Hospital Medical CenterBellevue · United States2026 · 1 papercurrent🏢MicrosoftRedmond · United States2014–2025 · 25 papers🎓Carnegie Mellon UniversityPittsburgh · United States2008–2013 · 8 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksHardware and Architecture · 2 worksComputer Vision and Pattern Recognition · 1 workInformation Systems · 1 work

🧭 Topics 1Research subjects and languages the work is about.GPU & parallel computing · 1 work

 Works by year

2020s

20212 papers

 Papers

The most cited first (OpenAlex and our library).

  1. ZeRO-Offload: Democratizing Billion-Scale Model Training (2021 · 309 citations)
    Training models with billions of parameters usually needs many GPUs, because existing parallel methods only work when the combined GPU memory can hold the parameters, gradients and optimizer states.
  2. ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning (2021 · 254 citations)
    Dense model sizes have grown roughly a thousandfold in three years, while single-GPU memory has grown only about fivefold.

All works

3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

  1. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
  2. ZeRO-Offload: Democratizing Billion-Scale Model TrainingarXiv:2101.06840Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.2021 · 309 citations
  3. ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep LearningSC 2021Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, et al.2021 · 254 citations

 Co-authors here

8 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 2,743 times (of the 149,439 papers whose bibliographies we read); 537 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/olatunji-ruwase/