Low-Precision Floating-Point Schemes for Neural Network Training

Marc Ortiz, Adrián Cristal, Eduard Ayguadé +1

The use of low-precision fixed-point arithmetic along with stochastic rounding has been proposed as a promising alternative to the commonly used 32-bit floating point arithmetic to…