4 papers
Ghosts of Softmax: Complex Singularities That Limit Safe Step Sizes in Cross-Entropy
Piyush Sao
Optimization analyses for cross-entropy training rely on local Taylor models of the loss to predict whether a proposed step will decrease the objective. These surrogates are reliab…
Fast Evaluation of Truncated Neumann Series by Low-Product Radix Kernels
Piyush Sao
Truncated Neumann series are used in approximate matrix inversion and polynomial preconditioning. In dense settings, matrix-matrix products dominate the…
What Trace Powers Reveal About Log-Determinants: Closed-Form Estimators, Certificates, and Failure Modes
Piyush Sao
Computing for large symmetric positive definite matrices arises in Gaussian process inference and Bayesian model comparison. Standard methods combine matrix-vector pr…
Interface for Sparse Linear Algebra Operations
Ahmad Abdelfattah, Willow Ahrens, Hartwig Anzt +32
The standardization of an interface for dense linear algebra operations in the BLAS standard has enabled interoperability between different linear algebra libraries, thereby boosti…