Armada: Memory-Efficient Distributed Training of Large-Scale Graph Neural Networks

Roger Waleffe, Devesh Sarda, Jason Mohoney +3

We study distributed training of Graph Neural Networks (GNNs) on billion-scale graphs that are partitioned across machines. Efficient training in this setting relies on min-edge-cu…