Optimal Deterministic First-Order Oracle Complexity for Nonconvex-Concave Minimax Optimization
Year: 2026
Type: preprint
Abstract: We study the deterministic first-order oracle complexity of smooth nonconvex-concave minimax optimization over a bounded convex dual domain under two notions of stationarity: optimization stationarity (OS) and game stationarity (GS). OS concerns stationarity of the value function, viewed as a structured nonsmooth objective obtained by maximizing over the dual variable. GS concerns the joint first-order optimality conditions for both primal minimization and dual maximization, each with the other variable held fixed. Existing upper bounds on the oracle complexity of first-order methods for finding $ε$-OS and $ε$-GS points have different dependence on $ε$, but whether this difference reflects an intrinsic separation in computational hardness remains unresolved. We resolve this question by establishing worst-case lower bounds for arbitrary deterministic first-order methods: $Ω(ε^{-3})$ oracle queries for finding an $ε$-OS point and $Ω(ε^{-5/2})$ for finding an $ε$-GS point, with the remaining problem parameters fixed. These bounds match existing upper bounds up to logarithmic factors. To close the remaining logarithmic gap, we introduce Tracked-FOAM, a new first-order algorithm whose oracle complexity matches our lower bounds for both OS and GS. Together, these results establish an intrinsic separation between OS and GS in the optimal accuracy dependence of deterministic first-order oracle complexity.
Source: arXiv (Cornell University)
Authors: Pan, Siyu, Zheng, Taoli, Li, Jiajin
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7213350592