MathDB1 problem
- 0 votes0 replies1 view
The constant-order minibatching conjecture for compute-optimal exponents
Consider mini-batching with a batch size that remains of constant order as the problem scales. Let the batch size case be the reference setting, and let compute-optimal exponen…