Why flatness does and does not correlate with generalization for deep neural networks

Shuofeng Zhang, Isaac Reid, Guillermo Valle Pérez +1

The intuition that local flatness of the loss landscape is correlated with better generalization for deep neural networks (DNNs) has been explored for decades, spawning many differ…