Selection and Estimation for Mixed Graphical Models

Abstract

We consider the problem of estimating the parameters in a pairwise graphical model in which the distribution of each node, conditioned on the others, may have a different parametric form. In particular, we assume that each node's conditional distribution is in the exponential family. We identify restrictions on the parameter space required for the existence of a well-defined joint density, and establish the consistency of the neighbourhood selection approach for graph reconstruction in high dimensions when the true underlying graph is sparse. Motivated by our theoretical results, we investigate the selection of edges between nodes whose conditional distributions take different parametric forms, and show that efficiency can be gained if edge estimates obtained from the regressions of particular nodes are used to reconstruct the graph. These results are illustrated with examples of Gaussian, Bernoulli, Poisson and exponential distributions. Our theoretical findings are corroborated by evidence from simulation studies.

References in corpus (9)

• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• Sharp thresholds for high-dimensional and noisy recovery of sparsity
• Stable Graphical Model Estimation with Random Forests for Discrete, Continuous, and Mixed Variables
• On Graphical Models via Univariate Exponential Family Distributions
• High-Dimensional Graphical Model Selection Using ${\ell }_1$-Regularized Logistic Regression
• Elliptical graphical modelling
• Mapping eQTL networks with mixed graphical Markov models
• Learning Mixed Graphical Models
• High-dimensional Mixed Graphical Models

Cited by in corpus (1)

• A General Framework for Mixed Graphical Models