Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction
arXiv:2006.06648
Abstract
Many practical graph problems, such as knowledge graph construction and drug-drug interaction prediction, require to handle multi-relational graphs. However, handling real-world multi-relational graphs with Graph Neural Networks (GNNs) is often challenging due to their evolving nature, as new entities (nodes) can emerge over time. Moreover, newly emerged entities often have few links, which makes the learning even more difficult. Motivated by this challenge, we introduce a realistic problem of few-shot out-of-graph link prediction, where we not only predict the links between the seen and unseen nodes as in a conventional out-of-knowledge link prediction task but also between the unseen nodes, with only few edges per node. We tackle this problem with a novel transductive meta-learning framework which we refer to as Graph Extrapolation Networks (GEN). GEN meta-learns both the node embedding network for inductive inference (seen-to-unseen) and the link prediction network for transductive inference (unseen-to-unseen). For transductive link prediction, we further propose a stochastic embedding layer to model uncertainty in the link prediction between unseen entities. We validate our model on multiple benchmark datasets for knowledge graph completion and drug-drug interaction prediction. The results show that our model significantly outperforms relevant baselines for out-of-graph link prediction tasks.
arXiv commentNeurIPS 2020
References in corpus (18)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Prototypical Networks for Few-shot Learning
- Inductive Representation Learning on Large Graphs
- Neural Message Passing for Quantum Chemistry
- Modeling polypharmacy side effects with graph convolutional networks
- Fast Graph Representation Learning with PyTorch Geometric
- A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network
- Variational Graph Auto-Encoders
- RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space
- Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
- On First-Order Meta-Learning Algorithms
- A Graph to Graphs Framework for Retrosynthesis Prediction
- Learning to Propagate for Graph Meta-Learning
- Meta-Graph: Few Shot Link Prediction via Meta Learning
- Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network Embedding
- GENN: Predicting Correlated Drug-drug Interactions with Graph Energy Neural Networks
- Out-of-Sample Representation Learning for Multi-Relational Graphs