81 citations · 151 across the 12 of their papers we have counts for
4 papers · 1 filter
From Local SGD to Local Fixed-Point Methods for Federated Learning
Grigory Malinovsky, Dmitry Kovalev, Elnur Gasanov +2
Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of f…
Distributed Fixed Point Methods with Compressed Iterates
Sélim Chraibi, Ahmed Khaled, Dmitry Kovalev +3
We propose basic and natural assumptions under which iterative optimization methods with compressed iterates can be analyzed. This problem is motivated by the practice of federated…
Stochastic Newton and Cubic Newton Methods with Simple Local Linear-Quadratic Rates
Dmitry Kovalev, Konstantin Mishchenko, Peter Richtárik
We present two new remarkably simple stochastic second-order methods for minimizing the average of a very large number of sufficiently smooth and strongly convex functions. The fir…
Don't Jump Through Hoops and Remove Those Loops: SVRG and Katyusha are Better Without the Outer Loop
Dmitry Kovalev, Samuel Horvath, Peter Richtarik
The stochastic variance-reduced gradient method (SVRG) and its accelerated variant (Katyusha) have attracted enormous attention in the machine learning community in the last few ye…