66 citations · 228 across the 17 of their papers we have counts for
Showing 2020 · math.OCShow all
2 papers · 2 filters
math.OC2020★ 31 cited
Random Reshuffling: Simple Analysis with Vast Improvements
Konstantin Mishchenko, Ahmed Khaled, Peter Richtárik
Random Reshuffling (RR) is an algorithm for minimizing finite-sum functions that utilizes iterative gradient descent steps in conjunction with data reshuffling. Often contrasted wi…
math.OC2020★ 59 cited
Better Theory for SGD in the Nonconvex World
Ahmed Khaled, Peter Richtárik
Large-scale nonconvex optimization problems are ubiquitous in modern machine learning, and among practitioners interested in solving them, Stochastic Gradient Descent (SGD) reigns…