2 papers
cs.LG2025
Position: Curvature Matrices Should Be Democratized via Linear Operators
Felix Dangel, Runa Eschenhagen, Weronika Ormaniec +3
Structured large matrices are prevalent in machine learning. A particularly important class is curvature matrices like the Hessian, which are central to understanding the loss land…
cs.LG2024
Debiasing Mini-Batch Quadratics for Applications in Deep Learning
Lukas Tatzel, Bálint Mucsányi, Osane Hackel +1
Quadratic approximations form a fundamental building block of machine learning methods. E.g., second-order optimizers try to find the Newton step into the minimum of a local quadra…