Adaptive Second-order Derivative Approximate Greatest Descent Optimization for Deep Learning Neural Networks
Year: 2019
Type: dissertation
Abstract: Backpropagation using Stochastic Diagonal Approximate Greatest Descent (SDAGD) is a novel adaptive second-order derivative optimization method in updating weights of deep learning neural networks. SDAGD applies two-phase switching strategy to seek for solution at far using long-term optimal trajectory and automatically switch to Newton method when nearer to optimal solution. SDAGD has the advantages of steepest training roll-off rate, adaptive adjustment of step-length and the ability to deal with vanishing gradient issues in deep architecture.
Source: eSpace (Curtin University)
Author: Hong Hui Tan
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funders: Nvidia, Curtin University of Technology
OpenAlex ID: W3008992957
