On the Role of Data Homogeneity in Multi-Agent Non-convex Stochastic Optimization

Qiang Li, Hoi-To Wai

This paper studies the role of data homogeneity on multi-agent optimization. Concentrating on the decentralized stochastic gradient (DSGD) algorithm, we characterize the transient…