Work

Distributed Robust Algorithms with Dependent Sampling

Year: 2025

Type: article

Abstract: Robust algorithms have been widely used and intensively studied in the communities of engineering, statistics, and machine learning since such algorithms are less sensitive to outliers and effective in addressing the issue of non-Gaussian noise during the learning process. In this paper we study the learning performance of a distributed robust algorithm with mixing dependent samples, where big data are collected distributively and have a dependence structure. Learning rates are derived by means of an integral operator decomposition technique and probability inequalities in Hilbert spaces. The results show that with a suitable robustification parameter, the performance of the distributed robust algorithm is comparable with that of its non-distributed counterpart, even if the dependent feature restricts the availability and the effective amount of data.

Source: Mathematics

DOI: 10.3390/math13233813

Authors: Baobin Wang, Ting Hu, Liangzhen Lei

Institutions: South Central Minzu University, Wuhan University of Science and Technology, Xi'an Jiaotong University, Capital Normal University

Language: English

Topic: Stochastic Gradient Optimization Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $3,137