Large-Sample Properties of Blind Estimation of the Linear Discriminant Using Projection Pursuit

Abstract

We study the estimation of the linear discriminant with projection pursuit, a method that is blind in the sense that it does not use the class labels in the estimation. Our viewpoint is asymptotic and, as our main contribution, we derive central limit theorems for estimators based on three different projection indices, skewness, kurtosis and their convex combination. The results show that in each case the limiting covariance matrix is proportional to that of linear discriminant analysis (LDA), an unblind estimator of the discriminant. An extensive comparative study between the asymptotic variances reveals that projection pursuit is able to achieve efficiency equal to LDA when the groups are arbitrarily well-separated and their sizes are reasonably balanced. We conclude with a real data example and a simulation study investigating the validity of the obtained asymptotic formulas for finite samples.

References in corpus (9)

• Moving Beyond Sub-Gaussianity in High-Dimensional Statistics: Applications in Covariance Estimation and Linear Regression
• Fourth Moments and Independent Component Analysis
• Large Deviation Methods for Approximate Probabilistic Inference
• Projection Pursuit for non-Gaussian Independent Components
• Quantum Expectation-Maximization for Gaussian Mixture Models
• The tube method for the moment index in projection pursuit
• REPPlab: An R package for detecting clusters and outliers using exploratory projection pursuit
• Parameter Estimation in Gaussian Mixture Models with Malicious Noise, without Balanced Mixing Coefficients
• Notion of information and independent component analysis

Cited by in corpus (3)

• Tandem clustering with invariant coordinate selection
• Unsupervised linear discrimination using skewness
• Invariant Coordinate Selection and Fisher discriminant subspace beyond the case of two groups