Grappa: Gradient-Only Communication for Scalable Graph Neural Network Training

Chongyang Xu, Christoph Siebenbrunner, Laurent Bindschaedler

Cross-partition edges dominate the cost of distributed GNN training: fetching remote features and activations per iteration overwhelms the network as graphs deepen and partition co…