Stochastic Blockmodels meet Graph Neural Networks

Abstract

Stochastic blockmodels (SBM) and their variants, $e.g.$, mixed-membership and overlapping stochastic blockmodels, are latent variable based generative models for graphs. They have proven to be successful for various tasks, such as discovering the community structure and link prediction on graph-structured data. Recently, graph neural networks, $e.g.$, graph convolutional networks, have also emerged as a promising approach to learn powerful representations (embeddings) for the nodes in the graph, by exploiting graph properties such as locality and invariance. In this work, we unify these two directions by developing a \emph{sparse} variational autoencoder for graphs, that retains the interpretability of SBMs, while also enjoying the excellent predictive performance of graph neural nets. Moreover, our framework is accompanied by a fast recognition model that enables fast inference of the node embeddings (which are of independent interest for inference in SBM and its variants). Although we develop this framework for a particular type of SBM, namely the \emph{overlapping} stochastic blockmodel, the proposed framework can be adapted readily for other types of SBMs. Experimental results on several benchmarks demonstrate encouraging results on link prediction while learning an interpretable latent structure that can be used for community discovery.

Cited by in corpus (9)

• A Survey of Community Detection Approaches: From Statistical Modeling to Deep Learning
• Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalization
• Learning Ideological Embeddings from Information Cascades
• Non-Parametric Graph Learning for Bayesian Graph Neural Networks
• Semi-supervised Anomaly Detection on Attributed Graphs
• Equipping SBMs with RBMs: An Explainable Approach for Analysis of Networks with Covariates
• Barlow Graph Auto-Encoder for Unsupervised Network Embedding
• A Block-based Generative Model for Attributed Networks Embedding
• Modeling Graph Node Correlations with Neighbor Mixture Models