Sparsity-based regularization for learning over multitask graphs
Year: 2025
Type: conference-paper
Abstract: In this work, we consider learning over multitask graphs, where each agent seeks to estimate its own parameter vector (task) while benefiting from collaboration with its neighboring agents with related tasks. A key method for promoting relationships between tasks is regularization. Unlike previous studies that enforce graph smoothness via graph-based smooth regularization, we investigate non-smooth regularization to promote sparsity and piecewise-constant transitions between tasks at neighboring agents. We formulate a globally regularized optimization problem and, motivated by the forward-backward splitting approach, we propose a decentralized approach for solving the non-smooth optimization problem. Then, under some general convexity assumptions on the individual costs and regularization, we study the convergence w.r.t. the optimal solution of the globally regularized cost, in the mean-square-error sense. Finally, we illustrate the theoretical findings and the effectiveness of the proposed approach through simulations.
Authors: Yara Zgheib, Marc Antonini, Roula Nassif
Institution: Centre National de la Recherche Scientifique
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funder: Agence Nationale de la Recherche
OpenAlex ID: W4413088369