Tight subgradient-norm convergence conjecture for the proximal point algorithm

Let fF0,(Rn)f\in\mathcal{F}_{0,\infty}(\mathbb{R}^n), let {αi}i1\{\alpha_i\}_{i\geq 1} be a sequence of positive step sizes, and let B0B\succ 0 define xB=xTBx\|x\|_B=\sqrt{x^{\mathsf T}Bx} and gB1=gTB1g\|g\|_{B^{-1}}=\sqrt{g^{\mathsf T}B^{-1}g}. Let xx_* be an optimal point and let x0Rnx_0\in\mathbb{R}^n satisfy x0xBR\|x_0-x_*\|_B\leq R. Let {xi}i1\{x_i\}_{i\geq 1} be generated by the proximal point algorithm with these step sizes.

Subgradient-norm convergence conjecture. For every iterate xNx_N, there exists a subgradient gNf(xN)g_N\in\partial f(x_N) such that

gNB1Ri=1Nαi.\|g_N\|_{B^{-1}}\leq\frac{R}{\sum_{i=1}^{N}\alpha_i}.

In particular, the proximal-point subgradient gN=(xN1xN)/αNg_N=(x_{N-1}-x_N)/\alpha_N is a subgradient satisfying this inequality.

This conjecture concerns the tight convergence rate of the residual subgradient norm for the proximal point algorithm over the class of proper lower semicontinuous convex functions represented by F0,\mathcal{F}_{0,\infty}. The preceding function-value rate is known to be tight, whereas the stated subgradient-norm bound is supported by numerical evidence and remains to be established in general.

Sources & referencesView supporting material

Primary source

Guoyong Gu and Junfeng Yang, “Tight Convergence Rate in Subgradient Norm of the Proximal Point Algorithm”, arXiv:2301.03175 (2023).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.