Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks

Umut Şimşekli, Ozan Sener, George Deligiannidis +1

Despite its success in a wide range of applications, characterizing the generalization properties of stochastic gradient descent (SGD) in non-convex deep learning problems is still…