Open-World Lifelong Graph Learning

Abstract

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt existing non-graph OOD detection methods to graph data. Crucially, we suggest performing new class detection by combining OOD detection methods with information aggregated from the graph neighborhood. Most OOD detection methods avoid determining a crisp threshold for deciding whether a vertex is OOD. To tackle this problem, we propose a Weakly-supervised Relevance Feedback (Open-WRF) method, which decreases the sensitivity to thresholds in OOD detection. We evaluate our approach on six benchmark datasets. Our results show that the proposed neighborhood aggregation method for OOD scores outperforms existing methods independent of the underlying graph neural network. Furthermore, we demonstrate that our Open-WRF method is more robust to threshold selection and analyze the influence of graph neighborhood on OOD detection. The aggregation and threshold methods are compatible with arbitrary graph neural networks and OOD detection methods, making our approach versatile and applicable to many real-world applications.

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Decoupled Weight Decay Regularization
• A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
• Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks
• Energy-based Out-of-distribution Detection
• Generalized Out-of-Distribution Detection: A Survey
• Uncertainty Aware Semi-Supervised Learning on Graph Data
• Graph-MLP: Node Classification without Message Passing in Graph
• Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration
• Learning on Graphs with Out-of-Distribution Nodes
• Lifelong Learning of Graph Neural Networks for Open-World Node Classification

Cited by in corpus (1)

• Topology-aware Embedding Memory for Continual Learning on Expanding Networks