Geometry-induced Regularization in Deep ReLU Neural Networks

Joachim Bona-Pellissier, François Malgouyres, François Bachoc

Neural networks with a large number of parameters often do not overfit, owing to implicit regularization that favors \lq good\rq{} networks. Other related and puzzling phenomena in…