Large Neural Networks Learning from Scratch with Very Few Data and without Explicit Regularization

Christoph Linse, Thomas Martinetz

Recent findings have shown that highly over-parameterized Neural Networks generalize without pretraining or explicit regularization. It is achieved with zero training error, i.e.,…