Work

Improved Conjugate Gradient Methods for Unconstrained Minimization Problems and Training Recurrent Neural Network

Year: 2025

Type: article

Abstract: ABSTRACT This research introduces two conjugate gradient methods, BIV1 and BIV2, designed to enhance the efficiency and performance of unconstrained optimization problems with only first derivative vectors. The study explores the derivation of new conjugate gradient parameters and investigates their practical performance. The proposed BIV1 and BIV2 methods are compared with the traditional Hestenes‐Stiefel (HS) method through a series of numerical experiments. These experiments evaluate the methods on various test problems sourced from the CUTE library and other unconstrained problem collections. Key performance metrics, including the number of iterations, function evaluations, and CPU time, demonstrate that both BIV1 and BIV2 methods offer superior efficiency and effectiveness compared to the HS method. Furthermore, the effectiveness of these methods is illustrated in the context of training artificial neural networks. Experimental results show that the new methods achieve competitive performance in terms of convergence rate and accuracy.

Source: Engineering Reports

DOI: 10.1002/eng2.70019

Authors: Bassim A. Hassan, Issam A. R. Moghrabi, Alaa Luqman Ibrahim, Hawraz N. Jabbar

Institutions: University of Mosul, University of Central Asia, Kuwait Technical College, University of Zakho, University of Kirkuk

Language: English

Topic: Advanced Optimization Algorithms Research

Subfield: Numerical Analysis

Field: Mathematics

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,270

OpenAlex ID: W4407311180

FWCI: 8.486

Cites: 39

Cited by: 8

Related to: 10