Missing values: sparse inverse covariance estimation and an extension to sparse regression
arXiv:0903.5463 · doi:10.1007/s11222-010-9219-7
Abstract
We propose an l1-regularized likelihood method for estimating the inverse covariance matrix in the high-dimensional multivariate normal model in presence of missing data. Our method is based on the assumption that the data are missing at random (MAR) which entails also the completely missing at random case. The implementation of the method is non-trivial as the observed negative log-likelihood generally is a complicated and non-convex function. We propose an efficient EM algorithm for optimization with provable numerical convergence properties. Furthermore, we extend the methodology to handle missing values in a sparse regression context. We demonstrate both methods on simulated and real data.
arXiv commentThe final publication is available at http://www.springerlink.com
References in corpus (5)
Cited by in corpus (22)
- High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity
- Covariance Matrix Estimation with Non Uniform and Data Dependent Missing Observations
- Pre-demosaic Graph-based Light Field Image Compression
- L1-Penalized Censored Gaussian Graphical Model
- Orthogonal Matching Pursuit with Noisy and Missing Data: Low and High Dimensional Results
- A Likelihood Ratio Framework for High Dimensional Semiparametric Regression
- Sparse multivariate regression with missing values and its application to the prediction of material properties
- Graph quilting: graphical model selection from partially observed covariances
- The conditional censored graphical lasso estimator
- Graphical Elastic Net and Target Matrices: Fast Algorithms and Software for Sparse Precision Matrix Estimation
- Discussion: Latent variable graphical model selection via convex optimization
- Pattern Alternating Maximization Algorithm for Missing Data in Large P, Small N Problems
- Methods for Recovering Conditional Independence Graphs: A Survey
- Scalable Interpretable Learning for Multi-Response Error-in-Variables Regression
- High-Dimensional Covariance Decomposition into Sparse Markov and Independence Models
- Active Learning for Undirected Graphical Model Selection
- Calibrated zero-norm regularized LS estimator for high-dimensional error-in-variables regression
- An Imputation-Consistency Algorithm for High-Dimensional Missing Data Problems and Beyond
- An ensemble learning method for variable selection: application to high dimensional data and missing values
- A generalized EMS algorithm for model selection with incomplete data
- Robust Compressed Sensing Under Matrix Uncertainties
- Mixed and missing data: a unified treatment with latent graphical models