🔗 Who cites «Memory-Efficient Pipeline-Parallel DNN Training»

98 papers of our library cite it (of the 149,439 whose bibliographies we read) · 14 with a page here, the most cited first · ← back to «Memory-Efficient Pipeline-Parallel DNN Training»

1. PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
2. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
3. GLM-130B: An Open Bilingual Pre-trained ModelarXiv:2210.02414Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 786 citations
4. The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
5. Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep LearningOSDI 2022Lianmin Zheng, Zhuohan Li, Hao Zhang, et al.2022 · 279 citations
6. Reducing Activation Recomputation in Large Transformer ModelsarXiv:2205.05198Vijay Korthikanti, Jared Casper, Sangkug Lym, et al.2022 · 273 citations
7. ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep LearningSC 2021Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, et al.2021 · 254 citations
8. Ring Attention with Blockwise Transformers for Near-Infinite ContextarXiv:2310.01889Hao Liu, Matei Zaharia, Pieter Abbeel2023 · 212 citations
9. DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer ModelsarXiv:2309.14509Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.2023 · 162 citations
10. Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language CapabilitiesarXiv:2404.17790Kazuki Fujii, Taishi Nakamura, Mengsay Loem, et al.2024 · 114 citations
11. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
12. Skeleton-of-Thought: Prompting LLMs for Efficient Parallel GenerationarXiv:2307.15337Xuefei Ning, Zinan Lin, Zixuan Zhou, et al.2023 · 72 citations
13. Seed1.5-VL Technical ReportarXiv:2505.07062Dong Guo, Faming Wu, Feida Zhu, et al.2025 · 67 citations
14. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731Shuohuan Wang, Yu Sun, Yang Xiang, et al.2021 · 63 citations

84 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/narayanan-2020-memory-efficient-pipeline-parallel-dnn/cited-by/