Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares
arXiv:1810.01323
Abstract
Statistical inferences for quadratic functionals of linear regression parameter have found wide applications including signal detection, global testing, inferences of error variance and fraction of variance explained. Classical theory based on ordinary least squares estimator works perfectly in the low-dimensional regime, but fails when the parameter dimension grows proportionally to the sample size . In some cases, its performance is not satisfactory even when . The main contribution of this paper is to develop {\em dimension-adaptive} inferences for quadratic functionals when . We propose a bias-and-variance-corrected test statistic and demonstrate that its theoretical validity (such as consistency and asymptotic normality) is adaptive to both low dimension with and moderate dimension with . Our general theory holds, in particular, without Gaussian design/error or structural parameter assumption, and applies to a broad class of quadratic functionals covering all aforementioned applications. As a by-product, we find that the classical fixed-dimensional results continue to hold {\em if and only if} the signal-to-noise ratio is large enough, say when diverges but slower than . Extensive numerical results demonstrate the satisfactory performance of the proposed methodology even when in some extreme cases. The mathematical arguments are based on the random matrix theory and leave-one-observation-out method.
arXiv commentTo appear in JASA-T&M
References in corpus (8)
- Higher criticism for detecting sparse heterogeneous mixtures
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Confidence sets in sparse regression
- Asymptotic behavior of unregularized and ridge-regularized high-dimensional robust regression estimators : rigorous results
- Testing linear hypotheses in high-dimensional regressions
- Robust Inference Under Heteroskedasticity via the Hadamard Estimator
- Optimal Estimation of Co-heritability in High-dimensional Linear Models