Graph Context Encoder: Graph Feature Inpainting for Graph Generation and Self-supervised Pretraining
arXiv:2106.10124
Abstract
We propose the Graph Context Encoder (GCE), a simple but efficient approach for graph representation learning based on graph feature masking and reconstruction. GCE models are trained to efficiently reconstruct input graphs similarly to a graph autoencoder where node and edge labels are masked. In particular, our model is also allowed to change graph structures by masking and reconstructing graphs augmented by random pseudo-edges. We show that GCE can be used for novel graph generation, with applications for molecule generation. Used as a pretraining method, we also show that GCE improves baseline performances in supervised classification tasks tested on multiple standard benchmark graph datasets.
arXiv comment13 pages, 4 figures
References in corpus (12)
- Auto-Encoding Variational Bayes
- Neural Message Passing for Quantum Chemistry
- Fast Graph Representation Learning with PyTorch Geometric
- Open Graph Benchmark: Datasets for Machine Learning on Graphs
- GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
- MolGAN: An implicit generative model for small molecular graphs
- Learning Deep Generative Models of Graphs
- GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generation
- Strategies for Pre-training Graph Neural Networks
- Efficient Graph Generation with Graph Recurrent Attention Networks
- A Two-Step Graph Convolutional Decoder for Molecule Generation
- Hierarchical Inter-Message Passing for Learning on Molecular Graphs