Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise

Thanh Dang, Melih Barsbey, A K M Rokonuzzaman Sonet +3

Understanding the generalization properties of optimization algorithms under heavy-tailed noise has gained growing attention. However, the existing theoretical results mainly focus…