Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises

Tianxi Zhu, Yi Xu, Xiangyang Ji

An increasing number of studies have focused on stochastic first-order methods (SFOMs) under heavy-tailed gradient noises, which have been observed in the training of practical dee…