Shift-Curvature, SGD, and Generalization

Arwen V. Bradley, Carlos Alberto Gomez-Uribe, Manish Reddy Vuyyuru

A longstanding debate surrounds the related hypotheses that low-curvature minima generalize better, and that SGD discourages curvature. We offer a more complete and nuanced view in…