MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models

Feihu Huang, Yuning Luo, Songcan Chen

Matrix-structured parameters frequently appear in many artificial intelligence models such as large language models. More recently, an efficient Muon optimizer is designed for matr…