Tight subgradient-norm convergence conjecture for the proximal point algorithm

About 3 years old · traced to

Let f∈F0,∞(Rn)f\in\mathcal{F}_{0,\infty}(\mathbb{R}^n), let {αi}i≥1\{\alpha_i\}_{i\geq 1} be a sequence of positive step sizes, and let B≻0B\succ 0 define ∥x∥B=xTBx\|x\|_B=\sqrt{x^{\mathsf T}Bx} and ∥g∥B−1=gTB−1g\|g\|_{B^{-1}}=\sqrt{g^{\mathsf T}B^{-1}g}. Let x∗x_* be an optimal point and let x0∈Rnx_0\in\mathbb{R}^n satisfy ∥x0−x∗∥B≤R\|x_0-x_*\|_B\leq R. Let {xi}i≥1\{x_i\}_{i\geq 1} be generated by the proximal point algorithm with these step sizes.

Subgradient-norm convergence conjecture. For every iterate xNx_N, there exists a subgradient gN∈∂f(xN)g_N\in\partial f(x_N) such that

∥gN∥B−1≤R∑i=1Nαi.\|g_N\|_{B^{-1}}\leq\frac{R}{\sum_{i=1}^{N}\alpha_i}.

In particular, the proximal-point subgradient gN=(xN−1−xN)/αNg_N=(x_{N-1}-x_N)/\alpha_N is a subgradient satisfying this inequality.

This conjecture concerns the tight convergence rate of the residual subgradient norm for the proximal point algorithm over the class of proper lower semicontinuous convex functions represented by F0,∞\mathcal{F}_{0,\infty}. The preceding function-value rate is known to be tight, whereas the stated subgradient-norm bound is supported by numerical evidence and remains to be established in general.

References

Primary source

Guoyong Gu and Junfeng Yang, “Tight Convergence Rate in Subgradient Norm of the Proximal Point Algorithm”, arXiv:2301.03175 (2023).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.