6 papers
Stochastic Rounding Increases Small Singular Values
Linkai Ma, Tingzhou Yu, Petros Drineas
Over the past half-dozen years, stochastic rounding (SR) has regained significant attention as a quantization scheme for low-precision floating-point arithmetic, with applications…
Game of Trust: How Trustworthy Does Your Blockchain Think You Are?
Petros Drineas, Rohit Nema, Rafail Ostrovsky +1
We investigate how a blockchain can distill the collective belief of its nodes regarding the trustworthiness of a (sub)set of nodes into a {\em reputation system} that reflects the…
Stacey: Promoting Stochastic Steepest Descent via Accelerated -Smooth Nonconvex Optimization
Xinyu Luo, Cedar Site Bai, Bolian Li +3
While popular optimization methods such as SGD, AdamW, and Lion depend on steepest descent updates in either or norms, there remains a critical gap in handli…
A Note on the Stability of the Sherman-Morrison-Woodbury Formula
Linkai Ma, Christos Boutsikas, Mehrdad Ghadiri +1
We study the numerical stability of the Sherman-Morrison-Woodbury (SMW) identity. Let and assume and both have full-column rank. We explore error bounds for…
Stochastic Rounding Implicitly Regularizes Tall-and-Thin Matrices
Gregory Dexter, Christos Boutsikas, Linkai Ma +2
Motivated by the popularity of stochastic rounding in the context of machine learning and the training of large-scale deep neural network models, we consider stochastic nearness ro…
Stochastic Rounding 2.0, with a View towards Complexity Analysis
Petros Drineas, Ilse C. F. Ipsen
Stochastic Rounding is a probabilistic rounding mode that is surprisingly effective in large-scale computations and low-precision arithmetic. Its random nature promotes error cance…