Faster Non-Convex Federated Learning via Global and Local Momentum

Rudrajit Das, Anish Acharya, Abolfazl Hashemi +3

We propose \texttt{FedGLOMO}, a novel federated learning (FL) algorithm with an iteration complexity of $\mathcal{O}({\epsilon }^{-1.5})$ to converge to an $\epsilon$-stationary point (i.e., $\math…