Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks

Elre T. Oldewage, Ross M. Clarke, José Miguel Hernández-Lobato

Despite their popularity in the field of continuous optimisation, second-order quasi-Newton methods are challenging to apply in machine learning, as the Hessian matrix is intractab…