Deep Generative Modeling in Network Science with Applications to Public Policy Research

Abstract

Network data is increasingly being used in quantitative, data-driven public policy research. These are typically very rich datasets that contain complex correlations and inter-dependencies. This richness both promises to be quite useful for policy research, while at the same time posing a challenge for the useful extraction of information from these datasets - a challenge which calls for new data analysis methods. In this report, we formulate a research agenda of key methodological problems whose solutions would enable new advances across many areas of policy research. We then review recent advances in applying deep learning to network data, and show how these methods may be used to address many of the methodological problems we identified. We particularly emphasize deep generative methods, which can be used to generate realistic synthetic networks useful for microsimulation and agent-based models capable of informing key public policy questions. We extend these recent advances by developing a new generative framework which applies to large social contact networks commonly used in epidemiological modeling. For context, we also compare and contrast these recent neural network-based approaches with the more traditional Exponential Random Graph Models. Lastly, we discuss some open problems where more progress is needed.

arXiv comment77 pages, 38 figures. This article is a RAND Working Report. v2: corrected typo in metadata

References in corpus (28)

• Auto-Encoding Variational Bayes
• Semi-Supervised Classification with Graph Convolutional Networks
• Inductive Representation Learning on Large Graphs
• Neural Message Passing for Quantum Chemistry
• Geometric deep learning: going beyond Euclidean data
• The spread of epidemic disease on networks
• Epidemic dynamics and endemic states in complex networks
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• Graph Neural Networks: A Review of Methods and Applications
• Variational Inference with Normalizing Flows
• Fast Graph Representation Learning with PyTorch Geometric
• Scaling and percolation in the small-world network model
• Powerlaw: a Python package for analysis of heavy-tailed distributions
• Variational Graph Auto-Encoders
• Kronecker Graphs: An Approach to Modeling Networks
• Velocity and hierarchical spread of epidemic outbreaks in scale-free networks
• GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
• MolGAN: An implicit generative model for small molecular graphs
• Learning Deep Generative Models of Graphs
• GraphSAINT: Graph Sampling Based Inductive Learning Method
• Efficient Graph Generation with Graph Recurrent Attention Networks
• Deep Learning on Graphs: A Survey
• GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders
• Exponential random graph model parameter estimation for very large directed networks
• Graph Normalizing Flows
• Image-Conditioned Graph Generation for Road Network Extraction
• Disentangling Interpretable Generative Parameters of Random and Real-World Graphs
• ERGMs are Hard