Work

OCP-GN: A Scalable Second-order Optimizer for Stochastic Optimization

Year: 2025
Type: preprint
Abstract: This paper proposes a novel second-order optimization algorithm based on the Optimal Control Principle (OCP), applicable to large-scale optimization problems in neural network training. The algorithm has a computational complexity of O(d) and strong robustness. Extensive experiments on multiple benchmarks demonstrate the significant superiority of the proposed method.
Open Access status: green
OpenAlex ID: W7117995014
Cites:
Cited by:
Related to: