Work

A Limited-Memory M5 Quasi-Newton Method

Year: 2026
Type: preprint
Abstract: We propose M5–LBFGS, a limited-memory quasi-Newton method for large-scale unconstrained optimization that combines the three-stage, fifth-order M5 method for nonlinear equations with the limited-memory BFGS (L-BFGS) method to approximate the inverse of the Hessian. A common inverse Hessian matrix with a damping parameter is used across all three stages. The damping parameter is selected by backtracking to satisfy the sufficient descent and Armijo conditions. Under the stated assumptions, we prove that the backtracking procedure terminates finitely and establish global convergence. We further establish R-linear convergence for the proposed M5–LBFGS method, trading the M5 method’s original fifth-order local convergence for a convergence guarantee compatible with the limited-memory quasi-Newton framework. Numerical experiments on large-scale CUTEst problems show that M5–LBFGS solves several problems that L-BFGS implementations fail to solve and substantially reduces the number of iterations on many test problems. However, these reductions do not consistently translate into lower central processing unit (CPU) time or fewer gradient evaluations due to M5’s multiple stages. The results, therefore, indicate that M5–LBFGS can be attractive when iteration reduction and robustness are important, while its computational advantage depends on the problem and the cost of gradient evaluations.
Language: English
Open Access status: green
OpenAlex ID: W7236707374
Cites: 26
Cited by:
Related to: 10