Stochastic Markov Gradient Descent and Training Low-Bit Neural Networks

Jonathan Ashbrock, Alexander M. Powell

The massive size of modern neural networks has motivated substantial recent interest in neural network quantization. We introduce Stochastic Markov Gradient Descent (SMGD), a discr…