Work

Potential-Function Proofs for First-Order Methods

Year: 2019
Type: article
Abstract: This note discusses proofs of convergence for gradient methods (also called “first-order methods”) based on simple potential-function arguments. We cover methods like gradient descent (for both smooth and non-smooth settings), mirror descent, and some accelerated variants. We hope the structure and presentation of these amortized-analysis proofs will be useful as a guiding principle in learning and using these proofs.
Language: English
Open Access status: diamond
OpenAlex ID: W2981349516
FWCI: 4.179
Cites: 36
Cited by: 106
Related to: 9