Variable selection for BART: An application to gene regulation

Abstract

We consider the task of discovering gene regulatory networks, which are defined as sets of genes and the corresponding transcription factors which regulate their expression levels. This can be viewed as a variable selection problem, potentially with high dimensionality. Variable selection is especially challenging in high-dimensional settings, where it is difficult to detect subtle individual effects and interactions between predictors. Bayesian Additive Regression Trees [BART, Ann. Appl. Stat. 4 (2010) 266-298] provides a novel nonparametric alternative to parametric regression approaches, such as the lasso or stepwise regression, especially when the number of relevant predictors is sparse relative to the total number of available predictors and the fundamental relationships are nonlinear. We develop a principled permutation-based inferential approach for determining when the effect of a selected predictor is likely to be real. Going further, we adapt the BART procedure to incorporate informed prior information about variable importance. We present simulations demonstrating that our method compares favorably to existing parametric and nonparametric procedures in a variety of data settings. To demonstrate the potential of our approach in a biological context, we apply it to the task of inferring the gene regulatory network in yeast (Saccharomyces cerevisiae). We find that our BART-based procedure is best able to recover the subset of covariates with the largest signal compared to other variable selection methods. The methods developed in this work are readily available in the R package bartMachine.

Published in at http://dx.doi.org/10.1214/14-AOAS755 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (6)

• BART: Bayesian additive regression trees
• Spike and slab variable selection: Frequentist and Bayesian strategies
• Variable selection for BART: An application to gene regulation
• Feature Selection via Regularized Trees
• Bayesian variable selection and data integration for biological regulatory networks
• Variable selection and sensitivity analysis using dynamic trees, with an application to computer code performance tuning

Cited by in corpus (18)

• Quantifying Uncertainty in Random Forests via Confidence Intervals and Hypothesis Tests
• Variable selection for BART: An application to gene regulation
• Bayesian additive regression trees and the General BART model
• bartMachine: Machine Learning with Bayesian Additive Regression Trees
• A New Spatial Count Data Model with Bayesian Additive Regression Trees for Accident Hot Spot Identification
• Performance of variable and function selection methods for estimating the non-linear health effects of correlated chemical mixtures: a simulation study
• Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration
• Variable selection with missing data in both covariates and outcomes: Imputation and machine learning
• Predicting Exporters with Machine Learning
• Operator-induced structural variable selection for identifying materials genes
• Assessing variable activity for Bayesian regression trees
• Bayesian Neural Tree Models for Nonparametric Regression
• Tree-Based Bayesian Treatment Effect Analysis
• Variable importance scores
• mBART: Multidimensional Monotone BART
• Comparing Broadband ISP Performance using Big Data from M-Lab
• BNPqte: A Bayesian Nonparametric Approach to Causal Inference on Quantiles in R
• Nonparametric competing risks analysis using Bayesian Additive Regression Trees (BART)