Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization

Shuntaro Nagashima, Hideaki Iiduka

The Muon optimizer has recently attracted attention due to its orthogonalized first-order updates, and a deeper theoretical understanding of its convergence behavior is essential f…