3 papers
cs.LG2026
How Much Orthogonalization Does Muon Need?
Hua Huang
Muon optimizers improve neural-network training by replacing ill-conditioned momentum updates with approximately semi-orthogonal updates. This motivates a practical question: how m…
cs.DC2024
Cascaded Prediction and Asynchronous Execution of Iterative Algorithms on Heterogeneous Platforms
Jianhua Gao, Bingjie Liu, Yizhuo Wang +2
Owing to the diverse scales and varying distributions of sparse matrices arising from practical problems, a multitude of choices are present in the design and implementation of spa…
cs.DC2024
Precision-Aware Iterative Algorithms Based on Group-Shared Exponents of Floating-Point Numbers
Jianhua Gao, Jiayuan Shen, Yuxiang Zhang +2
Iterative solvers are frequently used in scientific applications and engineering computations. However, the memory-bound Sparse Matrix-Vector (SpMV) kernel computation hinders the…