Arithmetic Simplicity in Stochastic Gradient Methods

Bin Fu, Pengfei Gu, Jose Nunez +1

A gradient descent method is arithmetically simple if the operations are limited to $+,-,\times$, and division $x/2^t$ with integer $t$. An arthmetically simple gradient method is…