Disparity Between Batches as a Signal for Early Stopping

Mahsa Forouzesh, Patrick Thiran

We propose a metric for evaluating the generalization ability of deep neural networks trained with mini-batch gradient descent. Our metric, called gradient disparity, is the $\ell_…