Nonconcave penalized composite conditional likelihood estimation of sparse Ising models

Abstract

The Ising model is a useful tool for studying complex interactions within a system. The estimation of such a model, however, is rather challenging, especially in the presence of high-dimensional parameters. In this work, we propose efficient procedures for learning a sparse Ising model based on a penalized composite conditional likelihood with nonconcave penalties. Nonconcave penalized likelihood estimation has received a lot of attention in recent years. However, such an approach is computationally prohibitive under high-dimensional Ising models. To overcome such difficulties, we extend the methodology and theory of nonconcave penalized likelihood to penalized composite conditional likelihood estimation. The proposed method can be efficiently implemented by taking advantage of coordinate-ascent and minorization--maximization principles. Asymptotic oracle properties of the proposed method are established with NP-dimensionality. Optimality of the computed local solution is discussed. We demonstrate its finite sample performance via simulation studies and further illustrate our proposal by studying the Human Immunodeficiency Virus type 1 protease structure based on data from the Stanford HIV drug resistance database. Our statistical learning results match the known biological findings very well, although no prior biological information is used in the data analysis procedure.

Published in at http://dx.doi.org/10.1214/12-AOS1017 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (13)

• Nearly unbiased variable selection under minimax concave penalty
• High-dimensional graphs and variable selection with the Lasso
• Coordinate descent algorithms for lasso penalized regression
• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• Variable selection using MM algorithms
• A unified approach to model selection and sparse recovery using regularized least squares
• L1-Penalization for Mixture Regression Models
• Penalized Composite Quasi-Likelihood for Ultrahigh-Dimensional Variable Selection
• Regularization for Cox's proportional hazards model with NP-dimensionality
• Estimation for High-Dimensional Linear Mixed-Effects Models Using ${\ell }_1$-Penalization
• Social applications of two-dimensional Ising models
• Evidence for Non-Random Hydrophobicity Structures in Protein Chains
• Discussion: One-step sparse estimates in nonconcave penalized likelihood models

Cited by in corpus (6)

• Strong oracle optimality of folded concave penalized estimation
• Multivariate Bernoulli distribution
• Change-Point Estimation in High-Dimensional Markov Random Field Models
• Estimating heterogeneous graphical models for discrete data with an application to roll call voting
• Aspects of likelihood inference
• Multivariate binary probability distribution in the Grassmann formalism