Gradient and Variable Tracking with Multiple Local SGD for Decentralized Non-Convex Learning

Songyang Ge, Tsung-Hui Chang

Stochastic distributed optimization methods that solve an optimization problem over a multi-agent network have played an important role in a variety of large-scale signal processin…