40 citations · 57 across the 11 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021
EF21 with Bells & Whistles: Six Algorithmic Extensions of Modern Error Feedback
Ilyas Fatkhullin, Igor Sokolov, Eduard Gorbunov +2
First proposed by Seide (2014) as a heuristic, error feedback (EF) is a very popular mechanism for enforcing convergence of distributed gradient-based optimization methods enhanced…
cs.LG2021★ 40 cited
EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback
Peter Richtárik, Igor Sokolov, Ilyas Fatkhullin
Error feedback (EF), also known as error compensation, is an immensely popular convergence stabilization mechanism in the context of distributed training of supervised machine lear…