Elamur Research⌕
☰
home / authors / Shuaiwen Leon Song

Shuaiwen Leon Song

Shuaiwen Leon Song has 2 papers in our library, in 2019–2023, most of them on Evaluation & benchmarks, GPU & parallel computing; often with Ang Li, Masahiro Tanaka, Minjia Zhang.

2 papers in our library · 2019–2023

OpenAlex · ORCID · Wikidata · h-index 27 · 123 works · 3,103 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 226 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #4099

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🔬Pacific Northwest National LaboratoryRichland · United States2013–2020 · 48 papers🎓The University of SydneySydney · Australia2019–2024 · 40 papers🎓Virginia TechBlacksburg · United States2009–2013 · 12 papers🎓William & MaryWilliamsburg · United States2017–2018 · 5 papers🏢MicrosoftRedmond · United States2023–2024 · 4 papers🤝Association for Computing MachineryNew York · United States2016–2021 · 2 papers🎓University of WashingtonSeattle · United States2021 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksHardware and Architecture · 2 worksComputer Networks and Communications · 1 workArts and Humanities · 1 workArtificial Intelligence · 1 workComputer Vision and Pattern Recognition · 1 workLanguage and Linguistics · 1 work

🧭 Topics 2Research subjects and languages the work is about.Evaluation & benchmarks · 1 workGPU & parallel computing · 1 work

 Works by year

2020s

20231 paper

2010s

20191 paper

 Papers

The most cited first (OpenAlex and our library).

  1. Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect (2019 · 372 citations)
    Multi-GPU computing is now essential for deep learning, big data and large-scale simulation. However, practitioners have little solid knowledge of how GPUs are wired together inside and across servers, or how much that wiring affects real workloads. The authors run a systematic empirical study of modern GPU…
  2. DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models (2023 · 162 citations)
    Standard LLM training parallelism splits work by batch (data parallelism), hidden size (tensor parallelism), or depth (pipeline parallelism).

All works

3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

  1. Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirectarXiv:1903.04611Ang Li, Shuaiwen Leon Song, Jieyang Chen, et al.2019 · 372 citations
  2. DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer ModelsarXiv:2309.14509Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.2023 · 162 citations
  3. When RL Meets Adaptive Speculative Training: A Unified Training-Serving System ↗arXiv (Cornell University) · no summary yetJunxiong Wang et al.2026

 Co-authors here

6 co-authors with a page, the most papers together first.

 Cited by

Papers of our library cite their works 226 times (of the 149,439 papers whose bibliographies we read); 26 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/shuaiwen-leon-song/