Limit Theorems for Stochastic Gradient Descent with Infinite Variance

Jose Blanchet, Aleksandar Mijatović, Wenhao Yang

Stochastic gradient descent is a classic algorithm that has gained great popularity especially in the last decades as the most common approach for training models in machine learni…