58 citations · 99 across the 23 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
math.OC2018
Nonlinear Acceleration of Momentum and Primal-Dual Algorithms
Raghu Bollapragada, Damien Scieur, Alexandre d'Aspremont
We describe convergence acceleration schemes for multistep optimization algorithms. The extrapolated solution is written as a nonlinear average of the iterates produced by the orig…
math.OC2018★ 58 cited
A Progressive Batching L-BFGS Method for Machine Learning
Raghu Bollapragada, Dheevatsa Mudigere, Jorge Nocedal +2
The standard L-BFGS method relies on gradient approximations that are not dominated by noise, so that search directions are descent directions, the line search is reliable, and qua…