ZO-COSMO: Index-Free One-Hop Mixing for Decentralized Zeroth-Order Optimization

Shengjun Zhang, Tingyi Liu, Heng Zhang +1

Sparse communication in decentralized zeroth-order learning requires compatible peer-state coordinates. We characterize this one-hop condition and develop \textsf{ZO-COSMO}, coupli…