SignSVRG: fixing SignSGD via variance reduction

Evgenii Chzhen, Sholom Schechtman

We consider the problem of unconstrained minimization of finite sums of functions. We propose a simple, yet, practical way to incorporate variance reduction techniques into SignSGD…