546 citations · 1.3k across the 14 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
stat.ML2017★ 546 cited
The Marginal Value of Adaptive Gradient Methods in Machine Learning
Ashia C. Wilson, Rebecca Roelofs, Mitchell Stern +2
Adaptive optimization methods, which perform local optimization with a metric constructed from the history of iterates, are becoming increasingly popular for training deep neural n…
math.OC2017★ 10 cited
Breaking Locality Accelerates Block Gauss-Seidel
Stephen Tu, Shivaram Venkataraman, Ashia C. Wilson +3
Recent work by Nesterov and Stich showed that momentum can be used to accelerate the rate of convergence for block Gauss-Seidel in the setting where a fixed partitioning of the coo…