3 problems

The paper considers non-convex optimization problems in the over-parameterized regime, where the parameter space has more degrees of freedom than are needed to fit the data. Simple…

Let $F$ be the loss of a neural network, and let $M(v_1,v_2,v_3)$ denote the linear space spanned by three vectors $v_1,v_2,v_3$. Mode-connectivity conjecture. If $\theta_1^*$ and…

Let $F$ be the loss of a neural network. For linearly independent vectors $v_1,v_2,v_3$, let $M(v_1,v_2,v_3)$ denote the linear space spanned by them. Barrier conjecture for global…