Convergence Analysis of Noisy Distributed Gradient Descent for Non-convex Optimization -- Saddle Point Escape

Lei Qin, Michael Cantoni, Ye Pu

This paper studies noisy distributed gradient descent (\textbf{NDGD}) for smooth non-convex finite-sum optimization over networks. Random perturbations enable saddle-point escape w…