Convergence of Practical Muon

Haonan Wang, Yu Wu, Minghui Liwang +2

Muon is emerging as a promising alternative to AdamW for large-scale neural network training, yet theoretical understanding of its practical implementation remains incomplete, as e…