A simple connection from loss flatness to compressed neural representations

Shirui Chen, Stefano Recanatesi, Eric Shea-Brown

Despite extensive study, the significance of sharpness -- the trace of the loss Hessian at local minima -- remains unclear. We investigate an alternative perspective: how sharpness…