The EAS approach to variable selection for multivariate response data in high-dimensional settings

Abstract

In this paper, we develop an {\em epsilon admissible subsets} (EAS) model selection approach for performing group variable selection in the high-dimensional multivariate regression setting. This EAS strategy is designed to estimate a posterior-like, generalized fiducial distribution over a parsimonious class of models in the setting of correlated predictors and/or in the absence of a sparsity assumption. The effectiveness of our approach, to this end, is demonstrated empirically in simulation studies, and is compared to other state-of-the-art model/variable selection procedures. Furthermore, assuming a matrix-Normal linear model we show that the EAS strategy achieves {\em strong model selection consistency} in the high-dimensional setting if there does exist a sparse, true data generating set of predictors. In contrast to Bayesian approaches for model selection, our generalized fiducial approach completely avoids the problem of simultaneously having to specify arbitrary prior distributions for model parameters and penalize model complexity; our approach allows for inference directly on the model complexity. \textcolor{black}{Implementation of the method is illustrated through yeast data to identify significant cell-cycle regulating transcription factors.

References in corpus (10)

• The pseudo-marginal approach for efficient Monte Carlo computations
• Bayesian variable selection with shrinking and diffusing priors
• Simultaneous Variable and Covariance Selection with the Multivariate Spike-and-Slab Lasso
• High-Dimensional Multivariate Posterior Consistency Under Global-Local Shrinkage Priors
• Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
• Handling correlated and repeated measurements with the smoothed multivariate square-root Lasso
• Generalized Concomitant Multi-Task Lasso for sparse multimodal regression
• Statistical control for spatio-temporal MEG/EEG source imaging with desparsified multi-task Lasso
• Chi-square and normal inference in high-dimensional multi-task regression
• New insights for the multivariate square-root lasso