On the generalization of learning algorithms that do not converge

Nisha Chandramoorthy, Andreas Loukas, Khashayar Gatmiry +1

Generalization analyses of deep learning typically assume that the training converges to a fixed point. But, recent results indicate that in practice, the weights of deep neural ne…