Showing 2026Show all
3 papers · 1 filter
cs.LG2026
RMNP: Row-Momentum Normalized Preconditioning for Scalable Matrix-Based Optimization
Shenyang Deng, Zhuoli Ouyang, Tianyu Pang +4
Preconditioned adaptive methods have gained significant attention for training deep neural networks, as they capture rich curvature information of the loss landscape. The central c…
cs.LG2026
Landscaper: Understanding Loss Landscapes Through Multi-Dimensional Topological Analysis
Jiaqing Chen, Nicholas Hadler, Tiankai Xie +8
Loss landscapes are a powerful tool for understanding neural network optimization and generalization, yet traditional low-dimensional analyses often miss complex topological featur…
cs.LG2026
Learning to Discover Iterative Spectral Algorithms
Zihang Liu, Oleg Balabanov, Yaoqing Yang +1
We introduce AutoSpec, a neural network framework for discovering iterative spectral algorithms for large-scale numerical linear algebra and numerical optimization. Our self-superv…