Work

Smoothing Functions for Sparse Optimization: A Unified Framework

Year: 2026

Type: article

Abstract: This paper presents a unified framework for constructing smoothing functions tailored to a broad class of widely used regularizers, including the plus function, the pinball function, the $$\ell _0$$ -norm, the $$\ell _p$$ -norm for $$0 < p \le 1$$ , the MCP, and the SCAD. By transforming nonsmooth regularizers into smooth approximations, the proposed framework facilitates the application of efficient optimization algorithms to sparse optimization problems. The framework is systematically derived from continuous approximations of the step function, offering a principled approach to generating smoothing functions across various regularizers. These approximations are, in turn, constructed using polynomial functions and the Dirac delta function.

Source: Journal of Optimization Theory and Applications

DOI: 10.1007/s10957-026-02975-7

Authors: Chieu Thanh Nguyen, Jein-Shan Chen

Institutions: Vietnam National University of Agriculture, National Taiwan Normal University

Language: English

Topic: Sparse and Compressive Sensing Techniques

Subfield: Computational Mechanics

Field: Engineering

Domain: Physical Sciences

Open Access status: hybrid

Estimated APC paid: $3,190

Funders: National Science and Technology Council, National Taiwan Normal University, National Science and Technology Council