3 problems
Mini-batch performance monotonicity conjecture. There exists a decreasing property for the expected loss, error and the generalization ability with respect to the mini-batch size.
Gradient-variance monotonicity conjecture. The variance of the gradient in each iteration is a decreasing function of the mini-batch size.
Interlaced averaging conjecture. This method should improve empirical results when the batch size is small compared to the latency term .