Second-Order Muon Done Right: A Principled Marriage of Spectral Geometry and Curvature

Tong Che

Muon's polar update is exact for an unweighted spectral geometry. We introduce GO-MUON, which uses a matched data-dependent geometry and reuses it across several optimization steps…