Convergence of Spectral Descent for Non-smooth Optimization

Yixuan Yang, Yuqing He, Song Li

The Muon optimizer has recently demonstrated remarkable empirical success in training large language models. However, the theoretical understanding of its mechanisms remains limite…