11 citations · 33 across the 9 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
math.OC2022★ 6 cited
Clipped Stochastic Methods for Variational Inequalities with Heavy-Tailed Noise
Eduard Gorbunov, Marina Danilova, David Dobre +3
Stochastic first-order methods such as Stochastic Extragradient (SEG) or Stochastic Gradient Descent-Ascent (SGDA) for solving smooth minimax problems and, more generally, variatio…
math.OC2022
On the Convergence Analysis of Aggregated Heavy-Ball Method
Marina Danilova
Momentum first-order optimization methods are the workhorses in various optimization tasks, e.g., in the training of deep neural networks. Recently, Lucas et al. (2019) proposed a…
math.OC2022
Distributed Methods with Absolute Compression and Error Compensation
Marina Danilova, Eduard Gorbunov
Distributed optimization methods are often applied to solving huge-scale problems like training neural networks with millions and even billions of parameters. In such applications,…