Properties of higher criticism under strong dependence

Abstract

The problem of signal detection using sparse, faint information is closely related to a variety of contemporary statistical problems, including the control of false-discovery rate, and classification using very high-dimensional data. Each problem can be solved by conducting a large number of simultaneous hypothesis tests, the properties of which are readily accessed under the assumption of independence. In this paper we address the case of dependent data, in the context of higher criticism methods for signal detection. Short-range dependence has no first-order impact on performance, but the situation changes dramatically under strong dependence. There, although higher criticism can continue to perform well, it can be bettered using methods based on differences of signal values or on the maximum of the data. The relatively inferior performance of higher criticism in such cases can be explained in terms of the fact that, under strong dependence, the higher criticism statistic behaves as though the data were partitioned into very large blocks, with all but a single representative of each block being eliminated from the dataset.

Published in at http://dx.doi.org/10.1214/009053607000000767 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (8)

• Higher criticism for detecting sparse heterogeneous mixtures
• A stochastic process approach to false discovery control
• Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
• Goodness-of-fit tests via phi-divergences
• Higher Criticism Statistic: Detecting and Identifying Non-Gaussianity in the WMAP First Year Data
• Estimation and confidence sets for sparse normal mixtures
• Asymptotic minimaxity of False Discovery Rate thresholding for sparse exponential data
• Cosmological non-Gaussian Signature Detection: Comparing Performance of Different Statistical Tests

Cited by in corpus (24)

• Two sample tests for high-dimensional covariance matrices
• Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
• Detection of an anomalous cluster in a network
• Innovated higher criticism for detecting sparse signals in correlated noise
• Higher Criticism for Large-Scale Inference, Especially for Rare and Weak Effects
• Tests alternative to higher criticism for high-dimensional means under sparsity and column-wise dependence
• Feature selection by Higher Criticism thresholding: optimal phase diagram
• Asymptotic optimality of the Westfall--Young permutation procedure for multiple testing under dependence
• Detection boundary and Higher Criticism approach for rare and weak genetic effects
• Goodness of fit tests in terms of local levels with special emphasis on higher criticism tests
• Rate optimal multiple testing procedure in high-dimensional regression
• Distribution-Free Tests for Sparse Heterogeneous Mixtures
• Effects of statistical dependence on multiple testing under a hidden Markov model
• On Minimax Exponents of Sparse Testing
• Sharp multiple testing boundary for sparse sequences
• Anomaly Detection for a Large Number of Streams: A Permutation-Based Higher Criticism Approach
• Variable Selection via Adaptive False Negative Control in Linear Regression
• Global Testing Against Sparse Alternatives under Ising Models
• Sparse Anomaly Detection Across Referentials: A Rank-Based Higher Criticism Approach
• Optimality of the max test for detecting sparse signals with Gaussian or heavier tail
• Sharp Signal Detection Under Ferromagnetic Ising Models
• Optimal detection of weak positive latent dependence between two sequences of multiple tests
• Diagonally-Dominant Principal Component Analysis
• Higher criticism for rare and weak non-proportional hazard deviations in survival analysis