Hessian Spectral Analysis at Foundation Model Scale

Diego Granziol, Khurshid Juarev

Accurate Hessian spectra of foundation models have remained out of reach, leading most prior work to rely on small models or strong structural approximations. We show that faithful…