Implicit Regularization in Over-parameterized Neural Networks

Masayoshi Kubo, Ryotaro Banno, Hidetaka Manabe +1

Over-parameterized neural networks generalize well in practice without any explicit regularization. Although it has not been proven yet, empirical evidence suggests that implicit r…