ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyond

Xiaojun Guo, Yifei Wang, Tianqi Du +1

Oversmoothing is a common phenomenon in a wide range of Graph Neural Networks (GNNs) and Transformers, where performance worsens as the number of layers increases. Instead of chara…