Elamur Research

Papers Topics Authors Mova's use Mova free

☰

Papers Topics Authors Mova's use Mova free

home / authors / Samyam Rajbhandari

Samyam Rajbhandari

4 papers on this site (2021–2023)

DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer ModelsSam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.2023 DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI ScaleSamyam Rajbhandari, Conglong Li, Zhewei Yao, et al.2022 Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelShaden Smith, Mostofa Patwary, Brandon Norick, et al.2022 ZeRO-Offload: Democratizing Billion-Scale Model TrainingJie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.2021

Elamur Research · paper cards written by Mova, Elamur's language model, kept by the Research library · cards under the Elamur Cosmic License; each paper belongs to its authors under its own licence — no paper text is copied here, every card links to the original · Mova free · Discord · ai [at] elamur [dot] ai