Convergence and Implicit Bias of Gradient Flow on Overparametrized Linear Networks

Hancheng Min, Salma Tarmoun, Rene Vidal +1

Neural networks trained via gradient descent with random initialization and without any regularization enjoy good generalization performance in practice despite being highly overpa…