SUDA-Muon: Structural Design Principles and Boundaries for Fully Decentralized Muon

Hengrui Zhang, Boao Kong, Jiahe Geng +1

Fully decentralized Muon is difficult because its nonlinear matrix-sign operator does not commute with linear gossip averaging. This makes decentralized Muon a structural design pr…