🔗 Who cites «Horovod: fast and easy distributed deep learning in TensorFlow»

223 papers of our library cite it (of the 149,439 whose bibliographies we read) · 12 with a page here, the most cited first · ← back to «Horovod: fast and easy distributed deep learning in TensorFlow»

1. HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
2. PyTorch Distributed: Experiences on Accelerating Data Parallel TrainingarXiv:2006.15704Shen Li, Yanli Zhao, Rohan Varma, et al.2020 · 348 citations
3. Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four MinutesarXiv:1807.11205Xianyan Jia, Shutao Song, Wei He, et al.2018 · 348 citations
4. Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep LearningOSDI 2022Lianmin Zheng, Zhuohan Li, Hao Zhang, et al.2022 · 279 citations
5. Ring Attention with Blockwise Transformers for Near-Infinite ContextarXiv:2310.01889Hao Liu, Matei Zaharia, Pieter Abbeel2023 · 212 citations
6. Tutel: Adaptive Mixture-of-Experts at ScaleMLSys 2023Changho Hwang, Wei Cui, Yifan Xiong, et al.2022 · 168 citations
7. DAPPLE: A Pipelined Data Parallel Approach for Training Large ModelsarXiv:2007.01045Shiqing Fan, Yi Rong, Chen Meng, et al.2020 · 107 citations
8. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731Shuohuan Wang, Yu Sun, Yang Xiang, et al.2021 · 63 citations
9. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 27 citations
10. JABER and SABER: Junior and Senior Arabic BERtarXiv:2112.04329Abbas Ghaddar, Yimeng Wu, Ahmad Rashid, et al.2021 · 16 citations
11. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language UnderstandingarXiv:2205.10687Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 9 citations
12. Survey on Key Technologies for Large Language Model Pre-training Systems (大语言模型预训练系统关键技术综述)Journal of SoftwareYanjie Gao (高彦杰), Yueguo Chen (陈跃国)2025

211 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/sergeev-2018-horovod-fast-easy-distributed-deep/cited-by/