1 problem

0 votes0 replies0 views
Improved convergence rate under higher moments for stochastic-gradient noise
Higher-moment rate conjecture. The rate $O(\sqrt{\eta_n})$ can be improved by assuming that $\xi^i_k$ has a high-order moment.
Conjectureopenconvergence-rates stochastic-gradient-descent underdamped-langevin-diffusionarXiv posted 2 days ago

Improved convergence rate under higher moments for stochastic-gradient noise