A General Framework for Mixed Graphical Models

Abstract

"Mixed Data" comprising a large number of heterogeneous variables (e.g. count, binary, continuous, skewed continuous, among other data types) are prevalent in varied areas such as genomics and proteomics, imaging genetics, national security, social networking, and Internet advertising. There have been limited efforts at statistically modeling such mixed data jointly, in part because of the lack of computationally amenable multivariate distributions that can capture direct dependencies between such mixed variables of different types. In this paper, we address this by introducing a novel class of Block Directed Markov Random Fields (BDMRFs). Using the basic building block of node-conditional univariate exponential families from Yang et al. (2012), we introduce a class of mixed conditional random field distributions, that are then chained according to a block-directed acyclic graph to form our class of Block Directed Markov Random Fields (BDMRFs). The Markov independence graph structure underlying a BDMRF thus has both directed and undirected edges. We introduce conditions under which these distributions exist and are normalizable, study several instances of our models, and propose scalable penalized conditional likelihood estimators with statistical guarantees for recovering the underlying network structure. Simulations as well as an application to learning mixed genomic networks from next generation sequencing expression data and mutation data demonstrate the versatility of our methods.

40 pages, 9 figures

References in corpus (8)

• Estimating high-dimensional directed acyclic graphs with the PC-algorithm
• Copula Gaussian graphical models and their application to modeling functional disability data
• Stability Approach to Regularization Selection (StARS) for High Dimensional Graphical Models
• Stable Graphical Model Estimation with Random Forests for Discrete, Continuous, and Mixed Variables
• On Graphical Models via Univariate Exponential Family Distributions
• Learning Mixed Graphical Models
• High-dimensional Mixed Graphical Models
• Selection and Estimation for Mixed Graphical Models

Cited by in corpus (7)

• Heterogeneous Multi-output Gaussian Process Prediction
• On Semiparametric Exponential Family Graphical Models
• Latent Multivariate Log-Gamma Models for High-Dimensional Multi-Type Responses with Application to Daily Fine Particulate Matter and Mortality Counts
• Adaptive Inferential Method for Monotone Graph Invariants
• Continuum directions for supervised dimension reduction
• Joint spatio-temporal analysis of multiple response types using the hierarchical generalized transformation model with application to coronavirus disease 2019 and social distancing
• A scalable quasi-Bayesian framework for Gaussian graphical models