Cross-feature Contrastive Loss for Decentralized Deep Learning on Heterogeneous Data

Sai Aparna Aketi, Kaushik Roy

The current state-of-the-art decentralized learning algorithms mostly assume the data distribution to be Independent and Identically Distributed (IID). However, in practical scenar…