Overcoming Challenges in Fixed Point Training of Deep Convolutional Networks

Darryl D. Lin, Sachin S. Talathi

It is known that training deep neural networks, in particular, deep convolutional networks, with aggressively reduced numerical precision is challenging. The stochastic gradient de…