Muon Operates Beyond the Edge of Stability

Niko Covic, Baraq Lipshitz, Alexander Padula +1

We study the Muon optimizer using sharpness and provide the first empirical evidence that the Flat Minima Hypothesis also applies to Muon. Further, we derive Muon's implicit precon…