28 citations · 85 across the 30 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022
On the influence of stochastic roundoff errors and their bias on the convergence of the gradient descent method with low-precision floating-point computation
Lu Xia, Stefano Massei, Michiel E. Hochstenbach +1
When implementing the gradient descent method in low precision, the employment of stochastic rounding schemes helps to prevent stagnation of convergence caused by the vanishing gra…
cs.LG2021★ 3 cited
A Simple and Efficient Stochastic Rounding Method for Training Neural Networks in Low Precision
Lu Xia, Martijn Anthonissen, Michiel Hochstenbach +1
Conventional stochastic rounding (CSR) is widely employed in the training of neural networks (NNs), showing promising training results even in low-precision computations. We introd…