Work

Delta-Iterations: A General-Purpose Linear Regression Solver for Huber's Penalty, $ε$-Insensitive Loss, and Other Moreau Envelope-Based Loss Functions

Year: 2026
Type: preprint
Abstract: A general-purpose linear regression solver for a class of smooth loss functions is presented. The method applies to loss functions of the Moreau envelope type, which are continuously differentiable and have Lipschitz-continuous first derivatives. This class includes piecewise-defined cost functions consisting of constant, linear and quadratic segments, such as Huber's loss, insensitive least squares, one-sided least squares. The convergence guarantee provided by the associated proximal operator, the simplicity of the method and its versatility in handling various cost functions within a unified framework are its main advantages. MATLAB code for reproducing the numerical results presented in this article is provided.
Language: English
Open Access status: green
OpenAlex ID: W7225993432
Cites: 9
Cited by:
Related to: 10