Get started
Keyword

RMSProp

Description: An adaptive gradient-based optimization algorithm that adjusts learning rates using a moving average of squared gradients, commonly used in machine learning.
OpenAlex ID: keywords/rmsprop
On the Convergence of Adam and Beyond
2019 · Reddi, Sashank J., Kale, Satyen, et al. · arXiv (Cornell University) · 1,771
PDF
Improved Adam Optimizer for Deep Neural Networks
2018 · Zijun Zhang · IEEE/ACM International Symposium on Quality of Service (IWQoS) · 1,584
On the Variance of the Adaptive Learning Rate and Beyond
2019 · Liu, Liyuan, Jiang, Haoming, et al. · arXiv (Cornell University) · 1,245
PDF
The Marginal Value of Adaptive Gradient Methods in Machine Learning
2017 · Wilson, Ashia C., Roelofs, Rebecca, et al. · arXiv (Cornell University) · 600
PDF
Dropout vs. batch normalization: an empirical study of their impact to deep learning
2020 · Christian Garbin, Xingquan Zhu, et al. · Multimedia Tools and Applications · 573
Adafactor: Adaptive Learning Rates with Sublinear Memory Cost
2018 · Shazeer, Noam, Stern, Mitchell · arXiv (Cornell University) · 455
PDF
A Sufficient Condition for Convergences of Adam and RMSProp
2019 · Fangyu Zou, Li Shen, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 446
PDF
A Comparative Analysis of Gradient Descent-Based Optimization Algorithms on Convolutional Neural Networks
2018 · E. M. Dogo, O. J. Afolabi, et al. · International Conference on Computational Techniques, Electronics and Mechanical Systems (CTEMS) · 367
Adaptive Gradient Methods with Dynamic Bound of Learning Rate
2019 · Luo, Liangchen, Xiong, Yuanhao, et al. · arXiv (Cornell University) · 353
PDF
Recent Advances in Stochastic Gradient Descent in Deep Learning
2023 · Yingjie Tian, Yuqi Zhang, et al. · Mathematics · 278
PDF
Adaptive Methods for Nonconvex Optimization
2018 · Manzil Zaheer, Sashank J. Reddi, et al. · neural information processing systems · 267
Deep neural network for traffic sign recognition systems: An analysis of spatial transformers and stochastic optimisation methods
2018 · Álvaro Arcos-García, Juan A. Álvarez-García, et al. · Neural Networks · 244
PDF
Convergence of the RMSProp deep learning method with penalty for nonconvex optimization
2021 · Dongpo Xu, Shengdong Zhang, et al. · Neural Networks · 232
The effect of choosing optimizer algorithms to improve computer vision tasks: a comparative study
2022 · Esraa Hassan, Mahmoud Y. Shams, et al. · Multimedia Tools and Applications · 217
PDF
The Marginal Value of Adaptive Gradient Methods in Machine Learning
2017 · Ashia C. Wilson, Rebecca Roelofs, et al. · neural information processing systems · 211
State-of-the-Art CNN Optimizer for Brain Tumor Segmentation in Magnetic Resonance Images
2020 · Muhammad Yaqub, Jinchao Feng, et al. · Brain Sciences · 208
PersonNet: Person Re-identification with Deep Convolutional Neural Networks
2016 · Wu, Lin, Shen, Chunhua, et al. · arXiv (Cornell University) · 194
PDF
Variants of RMSProp and Adagrad with Logarithmic Regret Bounds
2017 · Mukkamala, Mahesh Chandra, Hein, Matthias · arXiv (Cornell University) · 190
PDF
RMSProp and equilibrated adaptive learning rates for non-convex optimization.
2015 · Yann Dauphin, Harm de Vries, et al. · arXiv (Cornell University) · 182
A Study of the Optimization Algorithms in Deep Learning
2019 · Raniah Zaheer, Humera Shaziya · International Conference on Inventive Systems and Control (ICISC) · 176
Equilibrated adaptive learning rates for non-convex optimization
2015 · Dauphin, Yann N., de Vries, Harm, et al. · arXiv (Cornell University) · 172
PDF
Effectiveness assessment of Keras based deep learning with different robust optimization algorithms for shallow landslide susceptibility mapping at tropical area
2020 · Viet-Ha Nhu, Nhat-Duc Hoang, et al. · CATENA · 154
An optimized Q-Learning algorithm for mobile robot local path planning
2024 · Qian Zhou, Yang Lian, et al. · Knowledge-Based Systems · 151
Learned Optimizers that Scale and Generalize
2017 · Wichrowska, Olga, Maheswaranathan, Niru, et al. · arXiv (Cornell University) · 147
PDF
Classification of brain tumors from MR images using deep transfer learning
2021 · Özlem Polat, Cahfer Güngen · The Journal of Supercomputing · 146
Works count: 1,105
Citation count: 18,100
Year
Topic
Type