Optimized full cyclic coordinate descent has a superlinear numerical rate

Let NN denote the iteration count, and consider full fixed-step cyclic coordinate descent on a problem partitioned into 22 blocks, allowing the update to use all past gradient information, with the step sizes optimized numerically. Optimized full cyclic coordinate descent conjecture. Full cyclic coordinate descent with optimized step sizes can achieve a faster convergence rate than

O(1/N).\mathcal{O}(1/N).

For 22-block algorithms, the experiments suggest a rate of

O(1/N1.47).\mathcal{O}(1/N^{1.47}).

This is a numerical conjecture based on performance-estimation-problem upper bounds and fits; a theoretical guarantee for the improved rate is not provided.

Sources & referencesView supporting material

Primary source

Yassine Kamri, Julien M. Hendrickx and François Glineur, “Numerical Design of Optimized First-Order Algorithms”, arXiv:2507.20773 (2025).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.