Steady-state convergence and moment conjecture for general-objective SGD
Let f:cmathbbRctocmathbbRf:cmathbb{R}ctocmathbb{R}f:cmathbbRctocmathbbR be convex and of class Ch(cmathbbR)C^h(cmathbb{R})Ch(cmathbbR) for an even integer h>0h>0h>0, with unique minimizer x∗x^*x∗, satisfying limx→x∗f(k)(x)=0\lim_{x\to x^*}f^{(k)}(x)=0limx→x∗f(k)(x)=0 for…