Stability of SGD: Tightness Analysis and Improved Bounds

Yikai Zhang, Wenjia Zhang, Sammy Bald +3

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations h…