MathDB1 problem
- 0 votes0 replies0 views
Conjecture on the slowest-eigenvalue dominance of bias-error decay
Consider stochastic gradient descent with exponential moving average, and let the bias error be decomposed into components associated with the eigenspaces of the data-feature covar…