Keyword

large language model training

Description: The computational processes and infrastructure used to optimize large language model parameters from data, including distributed execution and fault tolerance.
OpenAlex ID: keywords/large-language-model-training
2020 · Samyam Rajbhandari, Jeff Rasley, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 2,927
2020 · Jeff Rasley, Samyam Rajbhandari, et al. · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · 2,520
2021 · Patterson, David, Gonzalez, Joseph, et al. · arXiv (Cornell University) · 2,317
2021 · Deepak Narayanan, Mohammad Shoeybi, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 1,754
2022 · Smith, Shaden, Patwary, Mostofa, et al. · arXiv (Cornell University) · 1,014
2023 · Norm Jouppi, George Kurian, et al. · Proceedings - International Symposium on Computer Architecture/Proceedings · 904
2025 · Liu, Jingyuan, Su, Jianlin, et al. · arXiv (Cornell University) · 738
2024 · Zhao, Jiawei, Zhang, Zhenyu, et al. · arXiv (Cornell University) · 630
2021 · Samyam Rajbhandari, Olatunji Ruwase, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 625
2024 · Sam Ade Jacobs, Masahiro Tanaka, et al. · ACM Symposium on Principles of Distributed Computing (PODC) · 394
2024 · Kun Qian, Yongqing Xi, et al. · ACM SIGCOMM Conference (SIGCOMM) · 310
2024 · Jiang, Ziheng, Lin, Haibin, et al. · arXiv (Cornell University) · 243
2024 · Mehdi Ali, Michael Fromm, et al. · Findings of the Association for Computational Linguistics: NAACL · 181
2020 · Narayanan, Deepak, Phanishayee, Amar, et al. · arXiv (Cornell University) · 176
2023 · Peng, Houwen, Wu, Kan, et al. · arXiv (Cornell University) · 171
2024 · Hsu, Pin-Lun, Dai, Yun, et al. · arXiv (Cornell University) · 170
2021 · Li, Zhuohan, Zhuang, Siyuan, et al. · arXiv (Cornell University) · 166
2023 · Yao, Zhewei, Aminabadi, Reza Yazdani, et al. · arXiv (Cornell University) · 162
2023 · Wortsman, Mitchell, Liu, Peter J., et al. · International Conference on Learning Representations · 139
2024 · Simon McIntosh-Smith, Sadaf Alam, et al. · Cray User Group Conference (CUG) · 129
2024 · Weiyang Wang, Manya Ghobadi, et al. · IEEE Symposium on High-Performance Interconnects (HOTI) · 123
2024 · Chang Chen, Xiuhong Li, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 116
2024 · Jiamin Cao, Yu Guan, et al. · ACM SIGCOMM Conference (SIGCOMM) · 115
2025 · Ahn, Kwangjun, Xu, Byron, et al. · arXiv (Cornell University) · 109
2023 · Wang, Guanhua, Qin, Heyang, et al. · International Conference on Learning Representations · 109
Works count: 1,244
Citation count: 25,550
Year
Topic
Type