394 citations · 402 across the 2 of their papers we have counts for
3 papers · 1 filter
On the Numerical Performance of Derivative-Free Optimization Methods Based on Finite-Difference Approximations
Hao-Jun Michael Shi, Melody Qiming Xuan, Figen Oztoprak +1
The goal of this paper is to investigate an approach for derivative-free optimization that has not received sufficient attention in the literature and is yet one of the simplest to…
A Noise-Tolerant Quasi-Newton Algorithm for Unconstrained Optimization
Hao-Jun Michael Shi, Yuchen Xie, Richard Byrd +1
This paper describes an extension of the BFGS and L-BFGS methods for the minimization of a nonlinear function subject to errors. This work is motivated by applications that contain…
A Progressive Batching L-BFGS Method for Machine Learning
Raghu Bollapragada, Dheevatsa Mudigere, Jorge Nocedal +2
The standard L-BFGS method relies on gradient approximations that are not dominated by noise, so that search directions are descent directions, the line search is reliable, and qua…