Turbo-Muon: Almost-Orthogonal Pre-Conditioning for Fast Muon Updates

Thibaut Boissin, Thomas Massena, Franck Mamalet +1

Orthogonality-based optimizers, such as Muon, have recently shown strong performance across large-scale training and community-driven efficiency challenges. However, these methods…