Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization

Zhen Qin, Zhishuai Liu, Pan Xu

signSGD is attractive in nonconvex optimization because it communicates sign-valued rather than full-precision gradients. Several standard analyses assume independent stochastic-gr…