Explicit Regularization via Regularizer Mirror Descent

Navid Azizan, Sahin Lale, Babak Hassibi

Despite perfectly interpolating the training data, deep neural networks (DNNs) can often generalize fairly well, in part due to the "implicit regularization" induced by the learnin…