Variable selection for model-based clustering using the integrated complete-data likelihood

Abstract

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty. However, the calibration of the penalty term can suffer from criticisms. Model selection methods are an efficient alternative, yet they require a difficult optimization of an information criterion which involves combinatorial problems. First, most of these optimization algorithms are based on a suboptimal procedure (e.g. stepwise method). Second, the algorithms are often greedy because they need multiple calls of EM algorithms. Here we propose to use a new information criterion based on the integrated complete-data likelihood. It does not require any estimate and its maximization is simple and computationally efficient. The original contribution of our approach is to perform the model selection without requiring any parameter estimation. Then, parameter inference is needed only for the unique selected model. This approach is used for the variable selection of a Gaussian mixture model with conditional independence assumption. The numerical experiments on simulated and benchmark datasets show that the proposed method often outperforms two classical approaches for variable selection.

submitted to Statistics and Computing

References in corpus (2)

• Bayesian variable selection for latent class analysis using a collapsed Gibbs sampler
• clustvarsel: A Package Implementing Variable Selection for Model-based Clustering in R

Cited by in corpus (6)

• Variable Selection Methods for Model-based Clustering
• Variable Selection for Latent Class Analysis with Application to Low Back Pain Diagnosis
• Variable selection for mixed data clustering: a model-based approach
• Clustering Approaches for Mixed-Type Data: A Comparative Study
• Model-based Clustering using Automatic Differentiation: Confronting Misspecification and High-Dimensional Data
• Bayesian Lifetime Regression with Multi-type Group-shared Latent Heterogeneity