3k citations · 24.2k across the 299 of their papers we have counts for
3 papers · 2 filters
A Lyapunov Analysis of Momentum Methods in Optimization
Ashia C. Wilson, Benjamin Recht, Michael I. Jordan
Momentum methods play a significant role in optimization. Examples include Nesterov's accelerated gradient method and the conditional gradient algorithm. Several momentum methods a…
Less than a Single Pass: Stochastically Controlled Stochastic Gradient Method
Lihua Lei, Michael I. Jordan
We develop and analyze a procedure for gradient-based optimization that we refer to as stochastically controlled stochastic gradient (SCSG). As a member of the SVRG family of algor…
A Variational Perspective on Accelerated Methods in Optimization
Andre Wibisono, Ashia C. Wilson, Michael I. Jordan
Accelerated gradient methods play a central role in optimization, achieving optimal rates in many settings. While many generalizations and extensions of Nesterov's original acceler…