From SGD to Muon: Adaptive Optimization via Schatten-p Norms

Thomas Massena, Corentin Friedrich, Mathieu Serrurier

Modern optimizers, like Muon, impose matrix-wise geometry constraints on their updates. These matrix-wise constraints can be unified under Linear Minimization Oracle (LMO) theory.…