Feature selection in omics prediction problems using cat scores and false nondiscovery rate control

Abstract

We revisit the problem of feature selection in linear discriminant analysis (LDA), that is, when features are correlated. First, we introduce a pooled centroids formulation of the multiclass LDA predictor function, in which the relative weights of Mahalanobis-transformed predictors are given by correlation-adjusted $t$-scores (cat scores). Second, for feature selection we propose thresholding cat scores by controlling false nondiscovery rates (FNDR). Third, training of the classifier is based on James--Stein shrinkage estimates of correlations and variances, where regularization parameters are chosen analytically without resampling. Overall, this results in an effective and computationally inexpensive framework for high-dimensional prediction with natural feature selection. The proposed shrinkage discriminant procedures are implemented in the R package ``sda'' available from the R repository CRAN.

Published in at http://dx.doi.org/10.1214/09-AOAS277 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (5)

• Classifier Technology and the Illusion of Progress
• High-dimensional classification using features annealed independence rules
• Entropy inference and the James-Stein estimator, with application to nonlinear gene association networks
• Microarrays, Empirical Bayes and the Two-Groups Model
• Gene ranking and biomarker discovery under correlation

Cited by in corpus (8)

• MALDIquant: a versatile R package for the analysis of mass spectrometry data
• Optimal whitening and decorrelation
• Higher Criticism for Large-Scale Inference, Especially for Rare and Weak Effects
• Gene ranking and biomarker discovery under correlation
• Differential protein expression and peak selection in mass spectrometry data by binary discriminant analysis
• Signal Identification for Rare and Weak Features: Higher Criticism or False Discovery Rates?
• Sparse Proteomics Analysis - A compressed sensing-based approach for feature selection and classification of high-dimensional proteomics mass spectrometry data
• i-Razor: A Differentiable Neural Input Razor for Feature Selection and Dimension Search in DNN-Based Recommender Systems