Work

The Query Complexity of Unknown Sparse Gradient Residuals

Year: 2026
Type: preprint
Abstract: We study optimization of an average of \(n\) functions when gradient predictions are exact except for at most \(k\) unknown components. An initial scan may miss these exceptions. For a class of smooth problems, we prove that the optimal worst-case expected number of component-gradient evaluations needed to find an approximate stationary point is \[ Θ\!\left(\min\left\{nk+\mathcal R,\frac nk\mathcal R\right\}\right), \] where \(\mathcal R\) represents the optimal cost when the exceptional components are known. Prediction evaluations are free. This bound shows that discovering even a few exceptions can cost more than one full scan and can account for most of the gradient evaluations.
Author: Dorn, Yuriy
Language: English
Open Access status: green
OpenAlex ID: W7226032430
Cites: 9
Cited by:
Related to: 10