Keyword

large batch training

Description: A machine-learning optimization approach that updates model parameters using many training examples per batch, especially in deep neural network training.
OpenAlex ID: keywords/large-batch-training
2020 · Chen, Xinlei, Fan, Haoqi, et al. · arXiv (Cornell University) · 4,388
2016 · Keskar, Nitish Shirish, Mudigere, Dheevatsa, et al. · arXiv (Cornell University) · 3,798
2024 · Jianlyu Chen, Shitao Xiao, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 3,206
2017 · Smith, Samuel L., Kindermans, Pieter-Jan, et al. · arXiv (Cornell University) · 1,222
2017 · You, Yang, Gitman, Igor, et al. · arXiv (Cornell University) · 1,208
2017 · Hoffer, Elad, Hubara, Itay, et al. · arXiv (Cornell University) · 778
2018 · Myle Ott, Sergey Edunov, et al. · Conference on Machine Translation (WMT) · 729
2018 · Yang You, Zhao Zhang, et al. · Proceedings of the International Conference on Parallel Processing · 542
2018 · McCandlish, Sam, Kaplan, Jared, et al. · arXiv (Cornell University) · 540
2018 · Lin, Tao, Stich, Sebastian U., et al. · arXiv (Cornell University) · 407
2019 · Fatih Cakir, Kun He, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 338
2017 · Yang You, Igor Gitman, et al. · arXiv (Cornell University) · 254
2024 · Vyas, Nikhil, Morwani, Depen, et al. · arXiv (Cornell University) · 253
2019 · Zhang, Guodong, Li, Lala, et al. · arXiv (Cornell University) · 195
2022 · Yong Liu, Siqi Mai, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 192
2020 · Saurabh Singh, Shankar Krishnan · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 183
2018 · Yao, Zhewei, Gholami, Amir, et al. · arXiv (Cornell University) · 177
2022 · Samyak Gupta, Yangsibo Huang, et al. · neural information processing systems · 141
2019 · Ginsburg, Boris, Castonguay, Patrice, et al. · arXiv (Cornell University) · 139
2025 · AI, Essential, :, et al. · arXiv (Cornell University) · 127
2022 · Jacek Komorowski · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · 125
2019 · Yang You, Jonathan Hseu, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 108
2022 · Damian, Alex, Nichani, Eshaan, et al. · arXiv (Cornell University) · 94
2019 · d'Autume, Cyprien de Masson, Rosca, Mihaela, et al. · arXiv (Cornell University) · 87
2021 · Charles, Zachary, Garrett, Zachary, et al. · arXiv (Cornell University) · 85
Works count: 238
Citation count: 21,740
Year
Topic
Type