How the Hessian-Spectrum of Neural Networks Depends on Data

Jasraj Singh, Enea Monzio Compagnoni, Antonio Orvieto

The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of ge…