Concave Penalized Estimation of Sparse Gaussian Bayesian Networks
arXiv:1401.0852
Abstract
We develop a penalized likelihood estimation framework to estimate the structure of Gaussian Bayesian networks from observational data. In contrast to recent methods which accelerate the learning problem by restricting the search space, our main contribution is a fast algorithm for score-based structure learning which does not restrict the search space in any way and works on high-dimensional datasets with thousands of variables. Our use of concave regularization, as opposed to the more popular (e.g. BIC) penalty, is new. Moreover, we provide theoretical guarantees which generalize existing asymptotic results when the underlying distribution is Gaussian. Most notably, our framework does not require the existence of a so-called faithful DAG representation, and as a result the theory must handle the inherent nonidentifiability of the estimation problem in a novel way. Finally, as a matter of independent interest, we provide a comprehensive comparison of our approach to several standard structure learning methods using open-source packages developed for the R language. Based on these experiments, we show that our algorithm is significantly faster than other competing methods while obtaining higher sensitivity with comparable false discovery rates for high-dimensional data. In particular, the total runtime for our method to generate a solution path of 20 estimates for DAGs with 8000 nodes is around one hour.
arXiv comment57 pages
References in corpus (10)
- Nearly unbiased variable selection under minimax concave penalty
- Pathwise coordinate optimization
- Estimating high-dimensional directed acyclic graphs with the PC-algorithm
- Strong oracle optimality of folded concave penalized estimation
- CAM: Causal additive models, high-dimensional order search and penalized regression
- Identifiability of Gaussian structural equation models with equal error variances
- Estimation of a Covariance Matrix with Zeros
- Finding Optimal Bayesian Networks
- Inferring large graphs using l1-penalized likelihood
- Learning Gaussian Networks
Cited by in corpus (7)
- Learning Large-Scale Bayesian Networks with the sparsebn Package
- Optimizing regularized Cholesky score for order-based learning of Bayesian networks
- Distributed recovery of jointly sparse signals under communication constraints
- Causal Fourier Analysis on Directed Acyclic Graphs and Posets
- Distributed Learning of Generalized Linear Causal Networks
- Model selection and local geometry
- A review of Gaussian Markov models for conditional independence