10 problems
- 0 votes0 replies1 view
Optimality of the silver stepsize rate among non-adaptive schedules
Silver-rate optimality conjecture. The asymptotic rate achieved by the silver stepsize schedule is optimal among all non-adaptive stepsize schedules.
- 0 votes0 replies0 views
Exact optimality of the silver stepsize schedule in strongly convex optimization
Silver-schedule optimality conjecture. The silver stepsize schedule is exactly optimal for this performance metric among stepsize schedules in the strongly convex setting.
- 0 votes0 replies0 views
Basic g-composable schedules capture minimax-optimal gradient-norm schedules
Basic g-composable schedule conjecture. For each , every minimax-optimal stepsize schedule solving
- 0 votes0 replies0 views
OBS-F schedules are minimax optimal
OBS-F minimax optimality conjecture. The OBS-F schedules are minimax optimal in the sense of the paper's minimax formulation.
- 0 votes0 replies0 views
Global optimality conjecture for concatenated stepsize schedules
Let the stepsize schedules generated by the algorithm in Definition be the schedules obtained by the paper's concatenation procedure for a given total iteration number . Global…
- 0 votes0 replies0 views
Coincidence conjecture for optimal concatenation indices of primitive stepsize schedules
Let denote the primitive stepsize schedule generated by Definition, let denote the concatenation operation, and let be the all-ones vec…
- 0 votes0 replies0 views
The rate conjecture for optimized stepsize schedules
Consider gradient descent for smooth convex optimization with time-varying stepsize schedules, and let denote the number of iterations. Optimized-schedule rate conjecture. Furt…
- 0 votes0 replies0 views
Optimality of the Silver Stepsize Schedule rate
Let , let with , and consider gradient descent on arbitrary smooth convex functions using stepsize schedules of leng…
- 0 votes0 replies0 views
Dynamic stepsizes accelerated-rate conjecture
Consider gradient descent with dynamic, time-varying stepsizes in the convex optimization setting, and let denote the number of iterations. Dynamic stepsizes accelerated-rate c…
- 0 votes0 replies0 views
Infinite-horizon Silver Stepsize Schedule rate conjecture
Let be a positive integer, and consider the infinite-horizon Silver Stepsize Schedule, whose -th normalized stepsize is , where denotes the smallest power o…