🧑🔬 Samyam Rajbhandari4 papers on this site (2021–2023)OpenAlex · ORCID · h-index 21 · 60 works · 4295 citations (openalex-snapshot, 2026-10-14)Profile data from OpenAlex; authors with the same name are not always told apart.DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer ModelsSam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.2023DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI ScaleSamyam Rajbhandari, Conglong Li, Zhewei Yao, et al.2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelShaden Smith, Mostofa Patwary, Brandon Norick, et al.2022ZeRO-Offload: Democratizing Billion-Scale Model TrainingJie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.2021This page in Markdown → https://md.research.elamur.ai/free/en/authors/samyam-rajbhandari/