Approximating Hessian matrices using Bayesian inference: a new approach for quasi-Newton methods in stochastic optimization

Andre Carlon, Luis Espath, Raul Tempone

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditi…