Does Muon Need Fine-Grained Spectral Shaping?

Meher Chaitanya, Tianyi Zhou, Aristides Gionis

Muon combines current and past gradients into matrix momentum. For $M=U\Sigma V^{\top }$, the idealized polar update $Q=U{V}^{\top }$ gives every singular direction the same weight. We refer to…