6 papers
A Second-Moment Theory for Floating-Point Reduction Trees
Piyush Sao, Narasinga Miniskar, Pedro Valero-Lara +2
Summation error depends on partial-sum order, which standard worst-case bounds omit. To capture this dependence, we derive an exact mean-square error (MSE) recurrence for a binary…
Contraction-Gauge Preconditioning for Quantized Matrix Multiplication
Piyush Sao, Narasinga Miniskar, Pedro Valero-Lara +2
We study low-precision computation of C=AB with both factors quantized. We derive an exact finite-dimensional identity for the expected squared product error under independent, zer…
Ghosts of Softmax: Complex Singularities That Limit Safe Step Sizes in Cross-Entropy
Piyush Sao
Optimization analyses for cross-entropy training rely on local Taylor models of the loss to predict whether a proposed step will decrease the objective. These surrogates are reliab…
Fast Evaluation of Truncated Neumann Series by Low-Product Radix Kernels
Piyush Sao
Truncated Neumann series are used in approximate matrix inversion and polynomial preconditioning. In dense settings, matrix-matrix products dominate the…
What Trace Powers Reveal About Log-Determinants: Closed-Form Estimators, Certificates, and Failure Modes
Piyush Sao
Computing for large symmetric positive definite matrices arises in Gaussian process inference and Bayesian model comparison. Standard methods combine matrix-vector pr…
Interface for Sparse Linear Algebra Operations
Ahmad Abdelfattah, Willow Ahrens, Hartwig Anzt +32
The standardization of an interface for dense linear algebra operations in the BLAS standard has enabled interoperability between different linear algebra libraries, thereby boosti…