High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise

Yuchen Yang, Kaihong Lu, Long Wang

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a noisy gradient of its own objective function, and can com…