On Emergence of Clean-Priority Learning in Early Stopped Neural Networks

Chaoyue Liu, Amirhesam Abedsoltan, Mikhail Belkin

When random label noise is added to a training dataset, the prediction error of a neural network on a label-noise-free test dataset initially improves during early training but eve…