Constrained High Dimensional Statistical Inference

Abstract

In typical high dimensional statistical inference problems, confidence intervals and hypothesis tests are performed for a low dimensional subset of model parameters under the assumption that the parameters of interest are unconstrained. However, in many problems, there are natural constraints on model parameters and one is interested in whether the parameters are on the boundary of the constraint or not. e.g. non-negativity constraints for transmission rates in network diffusion. In this paper, we provide algorithms to solve this problem of hypothesis testing in high-dimensional statistical models under constrained parameter space. We show that following our testing procedure we are able to get asymptotic designed Type I error under the null. Numerical experiments demonstrate that our algorithm has greater power than the standard algorithms where the constraints are ignored. We demonstrate the effectiveness of our algorithms on two real datasets where we have {\emph{intrinsic}} constraint on the parameters.

References in corpus (11)

• Community detection in graphs
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Asymptotic normality and optimalities in estimation of large Gaussian graphical models
• Exact Post-Selection Inference for Sequential Regression Procedures
• Selective Inference for Group-Sparse Linear Models
• Deep Learning for Predicting Asset Returns
• Estimating Differential Latent Variable Graphical Models with Applications to Brain Connectivity
• Estimation and Inference for Synthetic Control Methods with Spillover Effects
• Two-sample inference for high-dimensional Markov networks
• The bias of isotonic regression
• Factor Investing: A Bayesian Hierarchical Approach

Cited by in corpus (5)

• Lagrangian Inference for Ranking Problems
• Estimation and Inference for Synthetic Control Methods with Spillover Effects
• Synthetic Control Inference for Staggered Adoption
• Inference for Synthetic Control Methods with Multiple Treated Units
• Post-selection inference on high-dimensional varying-coefficient quantile regression model