Keyword

gradient accumulation

Description: A deep-learning training technique that sums gradients across multiple smaller batches before updating model parameters, reducing memory requirements.
OpenAlex ID: keywords/gradient-accumulation
2015 · Courbariaux, Matthieu, Bengio, Yoshua, et al. · arXiv (Cornell University) · 3,368
2004 · C. Wolf, J.-M. Jolion · Pattern Analysis and Applications · 224
2020 · Ruixuan Liu, Yang Cao, et al. · Lecture notes in computer science · 181
2022 · Cao, Chenjie, Ren, Xinlin, et al. · Transactions on machine learning research · 162
2021 · Xiaosen Wang, Jiadong Lin, et al. · British Machine Vision Conference (BMVC) · 132
2019 · Yang, Guandao, Zhang, Tianyi, et al. · arXiv (Cornell University) · 115
2024 · Sahil Nokhwal, Priyanka Chilakalapudi, et al. · International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence (ISMSI) · 89
2025 · Martin Marek, Sanae Lotfi, et al. · neural information processing systems · 66
2021 · Dylan G Hsu, Åse Ballangrud, et al. · Physics in Medicine and Biology · 47
2004 · A. Labun · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · 43
2021 · Yuan, Kun, Alghunaim, Sulaiman A., et al. · arXiv (Cornell University) · 37
2023 · Emani, Murali, Foreman, Sam, et al. · arXiv (Cornell University) · 31
2023 · Valipour, Mojtaba, Rezagholizadeh, Mehdi, et al. · arXiv (Cornell University) · 27
2024 · Huang, Wenke, Liang, Jian, et al. · arXiv (Cornell University) · 23
2021 · Zhiqiang Lv, Jianbo Li, et al. · Lecture notes in computer science · 22
2022 · Hao Tan, Zhaoquan Gu, et al. · Computers & Electrical Engineering · 21
2022 · Huangxing Lin, Weihong Zeng, et al. · IEEE Transactions on Neural Networks and Learning Systems · 21
2026 · Hui, Mude, Huang, Xin, et al. · arXiv (Cornell University) · 20
2025 · R. Prajwal, S. J. Pawan, et al. · Journal of Imaging · 20
2024 · Nikita Sakovich, Dmitry Aksenov, et al. · Technologies · 20
2022 · Axel Andersson, Nadezhda Koriakina, et al. · IEEE International Conference on Big Data (BigData) · 20
2023 · Zimeng Huang, Bo Jiang, et al. · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · 19
Works count: 269
Citation count: 5,330
Year
Topic
Type