Hyper-Learning for Gradient-Based Batch Size Adaptation

Calum Robert MacLellan, Feng Dong

Scheduling the batch size to increase is an effective strategy to control gradient noise when training deep neural networks. Current approaches implement scheduling heuristics that…