Stable Graphical Model Estimation with Random Forests for Discrete, Continuous, and Mixed Variables

Abstract

A conditional independence graph is a concise representation of pairwise conditional independence among many variables. Graphical Random Forests (GRaFo) are a novel method for estimating pairwise conditional independence relationships among mixed-type, i.e. continuous and discrete, variables. The number of edges is a tuning parameter in any graphical model estimator and there is no obvious number that constitutes a good choice. Stability Selection helps choosing this parameter with respect to a bound on the expected number of false positives (error control). The performance of GRaFo is evaluated and compared with various other methods for p = 50, 100, and 200 possibly mixed-type variables while sample size is n = 100 (n = 500 for maximum likelihood). Furthermore, GRaFo is applied to data from the Swiss Health Survey in order to evaluate how well it can reproduce the interconnection of functional health components, personal, and environmental factors, as hypothesized by the World Health Organization's International Classification of Functioning, Disability and Health (ICF). Finally, GRaFo is used to identify risk factors which may be associated with adverse neurodevelopment of children who suffer from trisomy 21 and experienced open-heart surgery. GRaFo performs well with mixed data and thanks to Stability Selection it provides an error control mechanism for false positive selection.

The authors report no conflict of interest. There was no external funding

References in corpus (1)

• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression

Cited by in corpus (16)

• On Semiparametric Exponential Family Graphical Models
• A General Framework for Mixed Graphical Models
• High-dimensional Mixed Graphical Models
• PANDA: AdaPtive Noisy Data Augmentation for Regularization of Undirected Graphical Models
• Adaptive Inferential Method for Monotone Graph Invariants
• Selection and Estimation for Mixed Graphical Models
• High Dimensional Semiparametric Latent Graphical Model for Mixed Data
• Graphical Models for Non-Negative Data Using Generalized Score Matching
• A Pipeline for Integrated Theory and Data-Driven Modeling of Genomic and Clinical Data
• Joint spatio-temporal analysis of multiple response types using the hierarchical generalized transformation model with application to coronavirus disease 2019 and social distancing
• Mixed Graphical Models for Causal Analysis of Multi-modal Variables
• Controlling false discoveries in high-dimensional situations: Boosting with stability selection
• AdaPtive Noisy Data Augmentation (PANDA) for Simultaneous Construction of Multiple Graph Models
• The scalable Birth-Death MCMC Algorithm for Mixed Graphical Model Learning with Application to Genomic Data Integration
• Mixed and missing data: a unified treatment with latent graphical models
• Combining Smoothing Spline with Conditional Gaussian Graphical Model for Density and Graph Estimation