Delta-Iterations: A General-Purpose Linear Regression Solver for Huber's Penalty, $ε$-Insensitive Loss, and Other Moreau Envelope-Based Loss Functions
Year: 2026
Type: preprint
Abstract: A general-purpose linear regression solver for a class of smooth loss functions is presented. The method applies to loss functions of the Moreau envelope type, which are continuously differentiable and have Lipschitz-continuous first derivatives. This class includes piecewise-defined cost functions consisting of constant, linear and quadratic segments, such as Huber's loss, insensitive least squares, one-sided least squares. The convergence guarantee provided by the associated proximal operator, the simplicity of the method and its versatility in handling various cost functions within a unified framework are its main advantages. MATLAB code for reproducing the numerical results presented in this article is provided.
Source: arXiv (Cornell University)
Author: Candan, Cagatay
Institution: Boğaziçi University
Language: English
Topic: Matrix Theory and Algorithms
Subfield: Computational Theory and Mathematics
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7225993432
