Relative Flatness and Generalization

Henning Petzka, Michael Kamp, Linara Adilova +2

Flatness of the loss curve is conjectured to be connected to the generalization ability of machine learning models, in particular neural networks. While it has been empirically obs…