activity
20202023
most citedA Simple and Efficient Stochastic Rounding Method for Training Neural Networks in Low Precision

3 citations · 5 across the 5 of their papers we have counts for

collaborators
Showing 2022Show all

1 paper · 1 filter

cs.LG2022

On the influence of stochastic roundoff errors and their bias on the convergence of the gradient descent method with low-precision floating-point computation

Lu Xia, Stefano Massei, Michiel E. Hochstenbach +1

When implementing the gradient descent method in low precision, the employment of stochastic rounding schemes helps to prevent stagnation of convergence caused by the vanishing gra…