Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise

Yidong Wu, Luo Luo

This paper considers the problem of asynchronous stochastic nonconvex optimization with heavy-tailed gradient noise and arbitrarily heterogeneous computation times across workers.…