Beyond Scaffold: A Unified Spatio-Temporal Gradient Tracking Method

Yan Huang, Jinming Xu, Jiming Chen +1

In distributed and federated learning algorithms, communication overhead is often reduced by performing multiple local updates between communication rounds. However, due to data he…