Keyword

model parallelism

Description: A distributed computing technique that partitions a machine learning model across processors or devices to enable parallel computation.
OpenAlex ID: keywords/model-parallelism
2020 · Samyam Rajbhandari, Jeff Rasley, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 2,924
2020 · Jeff Rasley, Samyam Rajbhandari, et al. · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 2,519
2013 · Quoc V. Le · IEEE International Conference on Acoustics Speech and Signal Processing · 1,935
2018 · Huang, Yanping, Cheng, Youlong, et al. · arXiv (Cornell University) · 1,388
2019 · Naumov, Maxim, Mudigere, Dheevatsa, et al. · arXiv (Cornell University) · 1,198
2021 · Black, Sid, Gao, Leo, et al. · Zenodo (CERN European Organization for Nuclear Research) · 979
2021 · Dmitry Lepikhin, HyoukJoong Lee, et al. · International Conference on Learning Representations · 854
2012 · Marc’Aurelio Ranzato, Rajat Monga, et al. · International Conference on Machine Learning · 823
2021 · Samyam Rajbhandari, Olatunji Ruwase, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 624
2018 · Anil, Rohan, Pereyra, Gabriel, et al. · arXiv (Cornell University) · 530
2021 · Ren, Jie, Rajbhandari, Samyam, et al. · arXiv (Cornell University) · 526
2018 · Shazeer, Noam, Cheng, Youlong, et al. · arXiv (Cornell University) · 467
2015 · Eric P. Xing, Qirong Ho, et al. · IEEE Transactions on Big Data · 448
2018 · Jia, Zhihao, Zaharia, Matei, et al. · arXiv (Cornell University) · 405
2025 · Jovan Stojkovic, Chaojie Zhang, et al. · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · 398
2011 · Le, Quoc V., Ranzato, Marc'Aurelio, et al. · arXiv (Cornell University) · 379
2021 · Zeng, Wei, Ren, Xiaozhe, et al. · arXiv (Cornell University) · 345
2023 · Li, Zhuohan, Zheng, Lianmin, et al. · arXiv (Cornell University) · 322
2021 · Xiang An, Xuhan Zhu, et al. · IEEE International Conference on Computer Vision Workshops · 298
2022 · Jiaao He, Jidong Zhai, et al. · ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · 254
2015 · Dettmers, Tim · arXiv (Cornell University) · 192
2021 · Li, Zhuohan, Zhuang, Siyuan, et al. · arXiv (Cornell University) · 166
2020 · Dennis Abts, Jonathan Ross, et al. · Proceedings - International Symposium on Computer Architecture/Proceedings · 160
2021 · Pham, Hieu, Dai, Zihang, et al. · arXiv (Cornell University) · 157
Works count: 609
Citation count: 27,220
Year
Topic
Type