4 papers
Constrained and Composite Optimization via Adaptive Sampling Methods
Yuchen Xie, Raghu Bollapragada, Richard Byrd +1
The motivation for this paper stems from the desire to develop an adaptive sampling method for solving constrained optimization problems in which the objective function is stochast…
Analysis of the BFGS Method with Errors
Yuchen Xie, Richard Byrd, Jorge Nocedal
The classical convergence analysis of quasi-Newton methods assumes that the function and gradients employed at each iteration are exact. In this paper, we consider the case when th…
Derivative-Free Optimization of Noisy Functions via Quasi-Newton Methods
Albert S. Berahas, Richard H. Byrd, Jorge Nocedal
This paper presents a finite difference quasi-Newton method for the minimization of noisy functions. The method takes advantage of the scalability and power of BFGS updating, and e…
Adaptive Sampling Strategies for Stochastic Optimization
Raghu Bollapragada, Richard Byrd, Jorge Nocedal
In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduct…