13 citations · 57 across the 29 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
math.OC2021
Averaged Heavy-Ball Method
Marina Danilova, Grigory Malinovsky
Heavy-Ball method (HB) is known for its simplicity in implementation and practical efficiency. However, as with other momentum methods, it has non-monotone behavior, and for optima…
cs.LG2021★ 1 cited
Random Reshuffling with Variance Reduction: New Analysis and Better Rates
Grigory Malinovsky, Alibek Sailanbayev, Peter Richtárik
Virtually all state-of-the-art methods for training supervised machine learning models are variants of SGD enhanced with a number of additional tricks, such as minibatching, moment…