Keyword

gradient explosion

Description: An instability in neural-network training in which gradients grow excessively large during backpropagation, causing unstable parameter updates or numerical failure.
OpenAlex ID: keywords/exploding-gradients
2012 · Pascanu, Razvan, Mikolov, Tomas, et al. · arXiv (Cornell University) · 5,072
2016 · Jiwon Kim, Jung Kwon Lee, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 3,440
2012 · Alex Graves · Studies in computational intelligence · 3,314
2020 · Greg Van Houdt, Carlos Mosquera, et al. · Artificial Intelligence Review · 2,419
2017 · Eldad Haber, Lars Ruthotto · Inverse Problems · 979
2012 · Razvan Pascanu, Tomáš Mikolov, et al. · arXiv (Cornell University) · 575
2017 · Balduzzi, David, Frean, Marcus, et al. · arXiv (Cornell University) · 471
2021 · Mei Liu, Liangming Chen, et al. · IEEE Transactions on Neural Networks and Learning Systems · 354
2019 · Zhang, Hongyi, Dauphin, Yann N., et al. · arXiv (Cornell University) · 342
2016 · Schoenholz, Samuel S., Gilmer, Justin, et al. · arXiv (Cornell University) · 315
2019 · Sun, Ruoyu · arXiv (Cornell University) · 283
2020 · Ruo-Yu Sun · Journal of the Operations Research Society of China · 282
2017 · Vorontsov, Eugene, Trabelsi, Chiheb, et al. · arXiv (Cornell University) · 257
2018 · Hanin, Boris · arXiv (Cornell University) · 233
2015 · Krähenbühl, Philipp, Doersch, Carl, et al. · arXiv (Cornell University) · 227
2021 · Nicolas Papernot, Abhradeep Thakurta, et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 206
2020 · Jiazhi Liang · Journal of Physics Conference Series · 182
2019 · Wiatrak, Maciej, Albrecht, Stefano V., et al. · arXiv (Cornell University) · 181
2023 · Guo-Feng Fan, Ying-Ying Han, et al. · Expert Systems with Applications · 176
2019 · Ribeiro, Antônio H., Tiels, Koen, et al. · arXiv (Cornell University) · 168
2023 · Ghojogh, Benyamin, Ghodsi, Ali · arXiv (Cornell University) · 161
2020 · Zhang, Bohang, Jin, Jikai, et al. · arXiv (Cornell University) · 160
2020 · Alexander Rehmer, Andreas Kroll · IFAC-PapersOnLine · 158
2025 · Xue, Zhenghai, Zheng, Longtao, et al. · arXiv (Cornell University) · 153
Works count: 539
Citation count: 26,970
Year
Topic
Type