On the Divergence of Decentralized Non-Convex Optimization

Mingyi Hong, Siliang Zeng, Junyu Zhang +1

We study a generic class of decentralized algorithms in which $N$ agents jointly optimize the non-convex objective $f(u):=1/N{\sum }_{i=1}^N{f}_i(u)$, while only communicating with th…