Orthogonal Witness Control for Muon Optimization via Sigmoid Spectral Reshaping

Dat Phi Van, Ngo Vu Minh, Tuc Nguyen +3

Matrix-valued optimizers such as Muon exploit the spectral structure of neural network updates through Newton--Schulz orthogonalization, but their near-flattening of the singular s…