Residual permutation test for regression coefficient testing

Abstract

We consider the problem of testing whether a single coefficient is equal to zero in linear models when the dimension of covariates $p$ can be up to a constant fraction of sample size $n$. In this regime, an important topic is to propose tests with finite-sample valid size control without requiring the noise to follow strong distributional assumptions. In this paper, we propose a new method, called residual permutation test (RPT), which is constructed by projecting the regression residuals onto the space orthogonal to the union of the column spaces of the original and permuted design matrices. RPT can be proved to achieve finite-population size validity under fixed design with just exchangeable noises, whenever $p<n/2$. Moreover, RPT is shown to be asymptotically powerful for heavy tailed noises with bounded $(1+t)$-th order moment when the true coefficient is at least of order $n^{-t/(1+t)}$ for $t\in [0,1]$. We further proved that this signal size requirement is essentially rate-optimal in the minimax sense. Numerical studies confirm that RPT performs well in a wide range of simulation settings with normal and heavy-tailed noise distributions.

References in corpus (13)

• Can parametric statistical methods be trusted for fMRI based group studies?
• On asymptotically optimal confidence regions and tests for high-dimensional models
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Controlling the false discovery rate via knockoffs
• Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
• High-Dimensional Inference: Confidence Intervals, $p$-Values and R-Software hdi
• The Hardness of Conditional Independence Testing and the Generalised Covariance Measure
• Conformalized Quantile Regression
• Linear Hypothesis Testing in Dense High-Dimensional Linear Models
• An Assumption-Free Exact Test For Fixed-Design Linear Models With Exchangeable Errors
• Beyond the Sharp Null: Randomization Inference, Bounded Null Hypotheses, and Confidence Intervals for Maximum Effects
• Asymptotic Validity and Finite-Sample Properties of Approximate Randomization Tests
• A Residual Bootstrap for High-Dimensional Regression with Near Low-Rank Designs