Beyond Over-smoothing: Uncovering the Trainability Challenges in Deep Graph Neural Networks

Jie Peng, Runlin Lei, Zhewei Wei

The drastic performance degradation of Graph Neural Networks (GNNs) as the depth of the graph propagation layers exceeds 8-10 is widely attributed to a phenomenon of Over-smoothing…