Closed-form worst-case conjecture for gradient descent on
Closed-form worst-case conjecture for gradient descent on
Let be the iteration number, let be the step size, and let be the operator-composed class defined in the source. For and , define
where is a solution of
Closed-form worst-case conjecture. The worst-case performance satisfies
The formula is obtained by solving the maximization suggested by the one-dimensional conjecture and the cited worst-case formula for smooth strongly convex functions; the supplied text does not establish it.
Sources & referencesView supporting material
Primary source
Nizar Bousselmi, Julien M. Hendrickx and François Glineur, “Interpolation Conditions for Linear Operators and Applications to Performance Estimation Problems”, arXiv:2302.08781 (2024).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.