Closed-form worst-case conjecture for gradient descent on DμgμM\mathcal{D}_{\mu_g}^{\mu_M}

Let NN be the iteration number, let hh be the step size, and let DμgμM\mathcal{D}_{\mu_g}^{\mu_M} be the operator-composed class defined in the source. For 0μg10\leq\mu_g\leq1 and 0μM10\leq\mu_M\leq1, define

M=proj[μM,1](h0h),M^*=\operatorname{proj}_{[\mu_M,1]}\left(\sqrt{\frac{h_0}{h}}\right),

where h0h_0 is a solution of

(1μg)(1μgh0)2N+1=1(2N+1)μgh0,0h01μg.(1-\mu_g)(1-\mu_g h_0)^{2N+1}=1-(2N+1)\mu_g h_0,\qquad 0\leq h_0\leq\frac{1}{\mu_g}.

Closed-form worst-case conjecture. The worst-case performance satisfies

w(DμgμM;h)=12max{μgM2μg1+(1μgM2h)2N,(1h)2N}.w(\mathcal{D}_{\mu_g}^{\mu_M};h)=\frac12\max\left\{\frac{\mu_g M^{*2}}{\mu_g-1+\left(1-\mu_g M^{*2}h\right)^{-2N}},(1-h)^{2N}\right\}.

The formula is obtained by solving the maximization suggested by the one-dimensional conjecture and the cited worst-case formula for smooth strongly convex functions; the supplied text does not establish it.

Sources & referencesView supporting material

Primary source

Nizar Bousselmi, Julien M. Hendrickx and François Glineur, “Interpolation Conditions for Linear Operators and Applications to Performance Estimation Problems”, arXiv:2302.08781 (2024).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.