Work

Riemannian SVRG with Barzilai-Borwein scheme for federated learning

Year: 2024

Type: article

Abstract: Federated learning problems with non-convex constrains have many applications in practice. Based on the Riemannian federated SVRG (RFedSVRG), we proposed a modified RFedSVRG method by using the Barzilai-Borwein strategy (RFedSVRG-BB), which computed the step size automatically. We analyzed the convergence under the cases of geodesically strongly convex functions and non-convex functions, respectively. Numerical results for the principal component analysis problem, the federated kernel principal component analysis problem, and the Karcher mean problem on the positive defined cone was reported to demonstrate the effectiveness of the proposed Riemannian method.

Source: Journal of Industrial and Management Optimization

DOI: 10.3934/jimo.2024137

Authors: He Xiao, Tao Yan, Shimin Zhao

Institution: Nanjing University of Science and Technology

Language: English

Topic: Stochastic Gradient Optimization Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: diamond

OpenAlex ID: W4403338839

FWCI:

Cites: 12

Cited by:

Related to: 10