Distributed Graph Neural Network Training with Periodic Stale Representation Synchronization

Zheng Chai, Guangji Bai, Liang Zhao +1

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many…