Principles for Initialization and Architecture Selection in Graph Neural Networks with ReLU Activations

Gage DeZoort, Boris Hanin

This article derives and validates three principles for initialization and architecture selection in finite width graph neural networks (GNNs) with ReLU activations. First, we theo…