Restart Strategies Enabling Automatic Differentiation for Hyperparameter Tuning in Inverse Problems
Year: 2024
Type: conference-paper
Abstract: Numerous signal/image processing tasks can be formulated as variational problems, whose solutions depend, often crucially, on the values of hyperparameters. Their automated selection usually involves the computation of gradients of a well chosen loss function, which often turns unfeasible analytically. The deep-learning inspired use of automatic differentiation to compute such gradients, though appealing, is significantly impaired by the usually large number of iterations inherently attached to functional minimization in variational problems. The present work proposes and assesses the use of a restart strategy for automated hyperparameter tuning, combining the benefits of automatic differentiation with properties of proximal iterative algorithms. It studies theoretically its conditions of applicability in a generic algorithmic framework and its specification to accelerated Chambolle-Pock iterations when dealing with strongly convex objective function. The effectiveness is illustrated for image denoising and texture segmentation problems.
Authors: Leo Davy, Nelly Pustelnik, Patrice Abry
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4393301192