Tandem clustering with invariant coordinate selection

Abstract

For multivariate data, tandem clustering is a well-known technique aiming to improve cluster identification through initial dimension reduction. Nevertheless, the usual approach using principal component analysis (PCA) has been criticized for focusing solely on inertia so that the first components do not necessarily retain the structure of interest for clustering. To address this limitation, a new tandem clustering approach based on invariant coordinate selection (ICS) is proposed. By jointly diagonalizing two scatter matrices, ICS is designed to find structure in the data while providing affine invariant components. Certain theoretical results have been previously derived and guarantee that under some elliptical mixture models, the group structure can be highlighted on a subset of the first and/or last components. However, ICS has garnered minimal attention within the context of clustering. Two challenges associated with ICS include choosing the pair of scatter matrices and selecting the components to retain. For effective clustering purposes, it is demonstrated that the best scatter pairs consist of one scatter matrix capturing the within-cluster structure and another capturing the global structure. For the former, local shape or pairwise scatters are of great interest, as is the minimum covariance determinant (MCD) estimator based on a carefully chosen subset size that is smaller than usual. The performance of ICS as a dimension reduction method is evaluated in terms of preserving the cluster structure in the data. In an extensive simulation study and empirical applications with benchmark data sets, various combinations of scatter matrices as well as component selection criteria are compared in situations with and without outliers. Overall, the new approach of tandem clustering with ICS shows promising results and clearly outperforms the PCA-based approach.

References in corpus (13)

• High-Breakdown Robust Multivariate Methods
• Minimum Covariance Determinant and Extensions
• Dimension reduction for model-based clustering
• A cautionary note on robust covariance plug-in methods
• MacroPCA: An all-in-one PCA method allowing for missing values as well as cellwise and rowwise outliers
• Central limit theorem and influence function for the MCD estimators at general multivariate distributions
• ICS for Multivariate Outlier Detection with Application to Quality Control
• Asymptotic and bootstrap tests for subspace dimension
• Asymptotic and bootstrap tests for the dimension of the non-Gaussian subspace
• Numerical considerations and a new implementation for ICS
• Large-Sample Properties of Blind Estimation of the Linear Discriminant Using Projection Pursuit
• Non-Gaussian component analysis: testing the dimension of the signal subspace
• Refining Invariant Coordinate Selection via Local Projection Pursuit