Tests alternative to higher criticism for high-dimensional means under sparsity and column-wise dependence

Abstract

We consider two alternative tests to the Higher Criticism test of Donoho and Jin [Ann. Statist. 32 (2004) 962-994] for high-dimensional means under the sparsity of the nonzero means for sub-Gaussian distributed data with unknown column-wise dependence. The two alternative test statistics are constructed by first thresholding $L_1$ and $L_2$ statistics based on the sample means, respectively, followed by maximizing over a range of thresholding levels to make the tests adaptive to the unknown signal strength and sparsity. The two alternative tests can attain the same detection boundary of the Higher Criticism test in [Ann. Statist. 32 (2004) 962-994] which was established for uncorrelated Gaussian data. It is demonstrated that the maximal $L_2$-thresholding test is at least as powerful as the maximal $L_1$-thresholding test, and both the maximal $L_2$ and $L_1$-thresholding tests are at least as powerful as the Higher Criticism test.

Published in at http://dx.doi.org/10.1214/13-AOS1168 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (4)

• A two-sample test for high-dimensional data with applications to gene-set testing
• Properties of higher criticism under strong dependence
• Robustness and accuracy of methods for high dimensional data analysis based on Student's t statistic
• Optimal Detection For Sparse Mixtures

Cited by in corpus (9)

• Higher Criticism for Large-Scale Inference, Especially for Rare and Weak Effects
• Simulation-Based Hypothesis Testing of High Dimensional Means Under Covariance Heterogeneity
• Bootstrapping High Dimensional Time Series
• Distribution and correlation free two-sample test of high-dimensional means
• Mean Test with Fewer Observation than Dimension and Ratio Unbiased Estimator for Correlation Matrix
• Optimal estimation of functionals of high-dimensional mean and covariance matrix
• A Neighborhood-Assisted Hotelling's $T^2$ Test for High-Dimensional Means
• Spatial-Sign based High-Dimensional Location Test
• Optimal Sign Test for High Dimensional Location Parameters