Alt-GDA convergence lower-bound conjecture for non-quadratic objectives
Alt-GDA convergence lower-bound conjecture for non-quadratic objectives
Let denote the function class considered for the alternating gradient descent-ascent method, and let , , and be the corresponding condition numbers. For constant step sizes , consider the convergence complexity of Alt-GDA on a function in this class. Alt-GDA convergence lower-bound conjecture. There exists a non-quadratic function
such that, for any constant step sizes , convergence of Alt-GDA requires iteration complexity
for . This conjecture concerns whether the presently established convergence upper bound for Alt-GDA can be complemented by a matching lower-bound construction for a non-quadratic objective.
Sources & referencesView supporting material
Primary source
Jaewook Lee, Hanseul Cho and Chulhee Yun, “Fundamental Benefit of Alternating Updates in Minimax Optimization”, arXiv:2402.10475 (2024).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.