SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimates

Zachary Frangella, Pratik Rathore, Shipu Zhao +1

SketchySGD improves upon existing stochastic gradient methods in machine learning by using randomized low-rank approximations to the subsampled Hessian and by introducing an automa…