Uncertainty Aware Semi-Supervised Learning on Graph Data

Abstract

Thanks to graph neural networks (GNNs), semi-supervised node classification has shown the state-of-the-art performance in graph data. However, GNNs have not considered different types of uncertainties associated with class probabilities to minimize risk of increasing misclassification under uncertainty in real life. In this work, we propose a multi-source uncertainty framework using a GNN that reflects various types of predictive uncertainties in both deep learning and belief/evidence theory domains for node classification predictions. By collecting evidence from the given labels of training nodes, the Graph-based Kernel Dirichlet distribution Estimation (GKDE) method is designed for accurately predicting node-level Dirichlet distributions and detecting out-of-distribution (OOD) nodes. We validated the outperformance of our proposed model compared to the state-of-the-art counterparts in terms of misclassification detection and OOD detection based on six real network datasets. We found that dissonance-based detection yielded the best results on misclassification detection while vacuity-based detection was the best for OOD detection. To clarify the reasons behind the results, we provided the theoretical proof that explains the relationships between different types of uncertainties considered in this work.

NeurIPS 2020 (Spotlight)

References in corpus (11)

• Distilling the Knowledge in a Neural Network
• What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
• A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Graph Neural Networks: A Review of Methods and Applications
• DropEdge: Towards Deep Graph Convolutional Networks on Node Classification
• Pitfalls of Graph Neural Network Evaluation
• Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference
• Evidential Deep Learning to Quantify Classification Uncertainty
• Decomposition of Uncertainty in Bayesian Deep Learning for Efficient and Risk-sensitive Learning
• Uncertainty quantification of molecular property prediction with Bayesian neural networks

Cited by in corpus (11)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
• Current and future directions in network biology
• GOOD-D: On Unsupervised Graph Out-Of-Distribution Detection
• Learning on Graphs with Out-of-Distribution Nodes
• Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation
• JuryGCN: Quantifying Jackknife Uncertainty on Graph Convolutional Networks
• Robust Node Classification on Graphs: Jointly from Bayesian Label Transition and Topology-based Label Propagation
• Open-World Lifelong Graph Learning
• Enhancing Adaptive Deep Networks for Image Classification via Uncertainty-aware Decision Fusion
• Uncertainty Propagation in Node Classification