48 citations · 130 across the 21 of their papers we have counts for
3 papers · 1 filter
Nonlinear Acceleration of Momentum and Primal-Dual Algorithms
Raghu Bollapragada, Damien Scieur, Alexandre d'Aspremont
We describe convergence acceleration schemes for multistep optimization algorithms. The extrapolated solution is written as a nonlinear average of the iterates produced by the orig…
Nonlinear Acceleration of CNNs
Damien Scieur, Edouard Oyallon, Alexandre d'Aspremont +1
The Regularized Nonlinear Acceleration (RNA) algorithm is an acceleration method capable of improving the rate of convergence of many optimization schemes such as gradient descend,…
Online Regularized Nonlinear Acceleration
Damien Scieur, Edouard Oyallon, Alexandre d'Aspremont +1
Regularized nonlinear acceleration (RNA) estimates the minimum of a function by post-processing iterates from an algorithm such as the gradient method. It can be seen as a regulari…