How the Hessian-Spectrum of Neural Networks Depends on Data

Jasraj Singh, Enea Monzio Compagnoni, Antonio Orvieto

The paper analytically derives the Hessian eigenvalues for linear neural networks of any size and data distribution, showing that solution sharpness under MSE loss is tied to the l…