Gaussian Parsimonious Clustering Models with Covariates and a Noise Component

Abstract

We consider model-based clustering methods for continuous, correlated data that account for external information available in the presence of mixed-type fixed covariates by proposing the MoEClust suite of models. These models allow different subsets of covariates to influence the component weights and/or component densities by modelling the parameters of the mixture as functions of the covariates. A familiar range of constrained eigen-decomposition parameterisations of the component covariance matrices are also accommodated. This paper thus addresses the equivalent aims of including covariates in Gaussian parsimonious clustering models and incorporating parsimonious covariance structures into all special cases of the Gaussian mixture of experts framework. The MoEClust models demonstrate significant improvement from both perspectives in applications to both univariate and multivariate data sets. Novel extensions to include a uniform noise component for capturing outliers and to address initialisation of the EM algorithm, model selection, and the visualisation of results are also proposed.

arXiv commentPublished in Advances in Data Analysis and Classification

References in corpus (1)

• Gaussian Parsimonious Clustering Models with Covariates and a Noise Component

Cited by in corpus (6)

• Gaussian Parsimonious Clustering Models with Covariates and a Noise Component
• Clustering Longitudinal Life-Course Sequences Using Mixtures of Exponential-Distance Models
• Identifying Brexit voting patterns in the British House of Commons: an analysis based on Bayesian mixture models with flexible concomitant covariate effects
• A self-adaptive and robust fission clustering algorithm via heat diffusion and maximal turning angle
• Mixture of partially linear experts
• Regularized joint mixture models