3 papers
math.NA2026
Stochastic Rounding Increases Small Singular Values
Linkai Ma, Tingzhou Yu, Petros Drineas
Over the past half-dozen years, stochastic rounding (SR) has regained significant attention as a quantization scheme for low-precision floating-point arithmetic, with applications…
math.NA2025
A Note on the Stability of the Sherman-Morrison-Woodbury Formula
Linkai Ma, Christos Boutsikas, Mehrdad Ghadiri +1
We study the numerical stability of the Sherman-Morrison-Woodbury (SMW) identity. Let and assume and both have full-column rank. We explore error bounds for…
cs.LG2024
Stochastic Rounding Implicitly Regularizes Tall-and-Thin Matrices
Gregory Dexter, Christos Boutsikas, Linkai Ma +2
Motivated by the popularity of stochastic rounding in the context of machine learning and the training of large-scale deep neural network models, we consider stochastic nearness ro…