Meta-Graph: Few Shot Link Prediction via Meta Learning

Abstract

We consider the task of few shot link prediction on graphs. The goal is to learn from a distribution over graphs so that a model is able to quickly infer missing edges in a new graph after a small amount of training. We show that current link prediction methods are generally ill-equipped to handle this task. They cannot effectively transfer learned knowledge from one graph to another and are unable to effectively learn from sparse samples of edges. To address this challenge, we introduce a new gradient-based meta learning framework, Meta-Graph. Our framework leverages higher-order gradients along with a learned graph signature function that conditionally generates a graph neural network initialization. Using a novel set of few shot link prediction benchmarks, we show that Meta-Graph can learn to quickly adapt to a new graph using only a small sample of true edges, enabling not only fast adaptation but also improved results at convergence.

References in corpus (16)

• Semi-Supervised Classification with Graph Convolutional Networks
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Link Prediction in Complex Networks: A Survey
• A Review of Relational Machine Learning for Knowledge Graphs
• Theoretical Models of Learning to Learn
• Variational Graph Auto-Encoders
• Predicting multicellular function through multi-layer tissue networks
• Learning to Remember Rare Events
• Meta-Learning with Latent Embedding Optimization
• Recasting Gradient-Based Meta-Learning as Hierarchical Bayes
• How to train your MAML
• Learning to Propagate for Graph Meta-Learning
• GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulation
• One-Shot Relational Learning for Knowledge Graphs
• Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphs

Cited by in corpus (12)

• Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation
• Trans4E: Link Prediction on Scholarly Knowledge Graphs
• Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction
• A Meta-Learning Approach for Graph Representation Learning in Multi-Task Settings
• Meta-Learning with Graph Neural Networks: Methods and Applications
• Fantastic Embeddings and How to Align Them: Zero-Shot Inference in a Multi-Shop Scenario
• Graph Meta Learning via Local Subgraphs
• Structure-Enhanced Meta-Learning For Few-Shot Graph Classification
• Self-supervised Auxiliary Learning for Graph Neural Networks via Meta-Learning
• What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Data
• One-shot Learning for Temporal Knowledge Graphs
• Meta-Active Learning for Node Response Prediction in Graphs