3 problems

Let $h$ be the step size, $d$ the dimension, and $m$ the parameter appearing in the preceding regularity and scaling assumptions. Let SG-UBU denote the stochastic-gradient UBU samp…

Let $\nu$ be the momentum parameter in quasi-hyperbolic momentum (QHM), and let $\alpha$ and $\beta$ denote its learning-rate and momentum parameters. For each fixed $\nu$, choose…

In nonparametric regression, let $zeta$ denote the source-condition exponent, and consider Nyström stochastic gradient methods using a subsampling technique. Subsampling conjecture…