Contrastive Multi-View Representation Learning on Graphs

Abstract

We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or contrasting multi-scale encodings do not improve performance, and the best performance is achieved by contrasting encodings from first-order neighbors and a graph diffusion. We achieve new state-of-the-art results in self-supervised learning on 8 out of 8 node and graph classification benchmarks under the linear evaluation protocol. For example, on Cora (node) and Reddit-Binary (graph) classification benchmarks, we achieve 86.8% and 84.5% accuracy, which are 5.5% and 2.4% relative improvements over previous state-of-the-art. When compared to supervised baselines, our approach outperforms them in 4 out of 8 benchmarks. Source code is released at: https://github.com/kavehhassani/mvgrl

ICML 2020

References in corpus (4)

• Variational Graph Auto-Encoders
• graph2vec: Learning Distributed Representations of Graphs
• Subgraph Matching Kernels for Attributed Graphs
• Relational Graph Representation Learning for Open-Domain Question Answering

Cited by in corpus (23)

• Contrastive Representation Learning: A Framework and Review
• Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning
• Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
• Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender System
• A Review-aware Graph Contrastive Learning Framework for Recommendation
• Memory-Guided Multi-View Multi-Domain Fake News Detection
• Improving Knowledge-aware Recommendation with Multi-level Interactive Contrastive Learning
• Dual Space Graph Contrastive Learning
• Contrastive Knowledge Graph Error Detection
• Contrastive Multi-Level Graph Neural Networks for Session-based Recommendation
• A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning
• GraphCrop: Subgraph Cropping for Graph Classification
• Relational Self-Supervised Learning on Graphs
• Node Similarity Preserving Graph Convolutional Networks
• Knowledge-aware Contrastive Molecular Graph Learning
• Socially-Aware Self-Supervised Tri-Training for Recommendation
• Learning Robust Representation through Graph Adversarial Contrastive Learning
• Self-Supervised Graph Co-Training for Session-based Recommendation
• CARL-G: Clustering-Accelerated Representation Learning on Graphs
• Self-supervised Graph Representation Learning via Bootstrapping
• Better with Less: A Data-Active Perspective on Pre-Training Graph Neural Networks
• Leveraging Meta-path Contexts for Classification in Heterogeneous Information Networks
• CLOP: Video-and-Language Pre-Training with Knowledge Regularizations