40 citations · 53 across the 3 of their papers we have counts for
4 papers
Sharp Analysis of Stochastic Optimization under Global Kurdyka-Łojasiewicz Inequality
Ilyas Fatkhullin, Jalal Etesami, Niao He +1
We study the complexity of finding the global solution to stochastic nonconvex optimization when the objective function satisfies global Kurdyka-Lojasiewicz (KL) inequality and the…
3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation
Peter Richtárik, Igor Sokolov, Ilyas Fatkhullin +3
We propose and study a new class of gradient communication mechanisms for communication-efficient training -- three point compressors (3PC) -- as well as efficient distributed nonc…
EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback
Peter Richtárik, Igor Sokolov, Ilyas Fatkhullin
Error feedback (EF), also known as error compensation, is an immensely popular convergence stabilization mechanism in the context of distributed training of supervised machine lear…
Optimizing Static Linear Feedback: Gradient Method
Ilyas Fatkhullin, Boris Polyak
The linear quadratic regulator is the fundamental problem of optimal control. Its state feedback version was set and solved in the early 1960s. However the static output feedback p…