A Precise Characterization of SGD Stability Using Loss Surface Geometry

Gregory Dexter, Borja Ocejo, Sathiya Keerthi +3

Stochastic Gradient Descent (SGD) stands as a cornerstone optimization algorithm with proven real-world empirical successes but relatively limited theoretical understanding. Recent…