IGLU: Efficient GCN Training via Lazy Updates

S Deepak Narayanan, Aditya Sinha, Prateek Jain +2

Training multi-layer Graph Convolution Networks (GCN) using standard SGD techniques scales poorly as each descent step ends up updating node embeddings for a large portion of the g…