Federated Compositional Muon Optimizer for Matrix-Wise Models

Wang Yan, Feihu Huang

Muon, a more recently developed optimizer, is useful for matrix-wise models in AI areas. Although many works have studied Muon and its variants, these methods are still not particu…