p2pGNN: A Decentralized Graph Neural Network for Node Classification in Peer-to-Peer Networks

Abstract

In this work, we aim to classify nodes of unstructured peer-to-peer networks with communication uncertainty, such as users of decentralized social networks. Graph Neural Networks (GNNs) are known to improve the accuracy of simple classifiers in centralized settings by leveraging naturally occurring network links, but graph convolutional layers are challenging to implement in decentralized settings when node neighbors are not constantly available. We address this problem by employing decoupled GNNs, where base classifier predictions and errors are diffused through graphs after training. For these, we deploy pre-trained and gossip-trained base classifiers and implement peer-to-peer graph diffusion under communication uncertainty. In particular, we develop an asynchronous decentralized formulation of diffusion that converges to centralized predictions in distribution and linearly with respect to communication rates. We experiment on three real-world graphs with node features and labels and simulate peer-to-peer networks with uniformly random communication frequencies; given a portion of known labels, our decentralized graph diffusion achieves comparable accuracy to centralized GNNs with minimal communication overhead (less than 3% of what gossip training already adds).

12 pages, 4 figures, 2 tables, accepted manuscript, IEEE Access

References in corpus (8)

• Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks
• Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks
• Simple and Deep Graph Convolutional Networks
• Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication
• Decentralized Federated Learning: A Segmented Gossip Approach
• Combining Label Propagation and Simple Models Out-performs Graph Neural Networks
• Localized Algorithm of Community Detection on Large-Scale Decentralized Social Networks
• Communication-efficient Decentralized Machine Learning over Heterogeneous Networks