Work

On $\ell_{0}$ Bregman-Relaxations for Kullback-Leibler Sparse Regression

Year: 2024

Type: conference-paper

Abstract: The resolution of optimization problems involving the$\ell_{0}$pseudo-norm has proven to be of importance in signal processing and ma-chine learning applications for selecting relevant variables. Among the vast class of existing approaches dealing with the intrinsic NP-hardness of such problems, continuous (possibly non-convex) re-laxations have been increasingly considered over the recent years. The notion of$\ell_{0}$-Bregman relaxation (B-rex) has been recently in-troduced to construct effective relaxations of$\ell_{0}$-regularized objectives with general data terms. These relaxations are termed exact in the sense that they preserve the global minimizers while removing some local minimizers. In this study, we deepen this idea further for$\ell_{0}$-regularized Kullback-Leibler regression problems, designing a tailored B-rex. Compared to other relaxations, it further reduces the number of local minimizers of the original problem by means of a suitable analytical/geometrical modeling. To better exploit the geometry of the relaxed problem, we deploy a dedicated Bregman proximal gradient algorithm for its minimization.

Source: IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

DOI: 10.1109/mlsp58920.2024.10734806

Authors: M'hamed Essafri, Luca Calatroni, Emmanuel Soubies