NRGNN: Learning a Label Noise-Resistant Graph Neural Network on Sparsely and Noisily Labeled Graphs

Abstract

Graph Neural Networks (GNNs) have achieved promising results for semi-supervised learning tasks on graphs such as node classification. Despite the great success of GNNs, many real-world graphs are often sparsely and noisily labeled, which could significantly degrade the performance of GNNs, as the noisy information could propagate to unlabeled nodes via graph structure. Thus, it is important to develop a label noise-resistant GNN for semi-supervised node classification. Though extensive studies have been conducted to learn neural networks with noisy labels, they mostly focus on independent and identically distributed data and assume a large number of noisy labels are available, which are not directly applicable for GNNs. Thus, we investigate a novel problem of learning a robust GNN with noisy and limited labels. To alleviate the negative effects of label noise, we propose to link the unlabeled nodes with labeled nodes of high feature similarity to bring more clean label information. Furthermore, accurate pseudo labels could be obtained by this strategy to provide more supervision and further reduce the effects of label noise. Our theoretical and empirical analysis verify the effectiveness of these two strategies under mild conditions. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method in learning a robust GNN with noisy and limited labels.

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• Distributed Representations of Words and Phrases and their Compositionality
• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Deep Convolutional Networks on Graph-Structured Data
• Understanding deep learning requires rethinking generalization
• Variational Graph Auto-Encoders
• Training Deep Neural Networks on Noisy Labels with Bootstrapping
• Deep Neural Networks for Bot Detection
• How Powerful are Graph Neural Networks?
• Transferring Robustness for Graph Neural Network Against Poisoning Attacks
• Decoupling "when to update" from "how to update"
• SELF: Learning to Filter Noisy Labels with Self-Ensembling
• Learning Graph Neural Networks with Noisy Labels
• On the Equivalence of Decoupled Graph Convolution Network and Label Propagation

Cited by in corpus (8)

• Unnoticeable Backdoor Attacks on Graph Neural Networks
• SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization
• Learning on Graphs with Out-of-Distribution Nodes
• Exploring Edge Disentanglement for Node Classification
• Robust Node Classification on Graphs: Jointly from Bayesian Label Transition and Topology-based Label Propagation
• FairSample: Training Fair and Accurate Graph Convolutional Neural Networks Efficiently
• PreGIP: Watermarking the Pretraining of Graph Neural Networks for Deep Intellectual Property Protection
• Towards Self-Explainable Graph Neural Network