Approximating posteriors with high-dimensional nuisance parameters via integrated rotated Gaussian approximation
arXiv:1909.06753 · doi:10.1093/biomet/asaa068
Abstract
Posterior computation for high-dimensional data with many parameters can be challenging. This article focuses on a new method for approximating posterior distributions of a low- to moderate-dimensional parameter in the presence of a high-dimensional or otherwise computationally challenging nuisance parameter. The focus is on regression models and the key idea is to separate the likelihood into two components through a rotation. One component involves only the nuisance parameters, which can then be integrated out using a novel type of Gaussian approximation. We provide theory on approximation accuracy that holds for a broad class of forms of the nuisance component and priors. Applying our method to simulated and real data sets shows that it can outperform state-of-the-art posterior approximation approaches.
arXiv comment35 pages, 8 figures
References in corpus (15)
- Rejoinder to "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Batch means and spectral variance estimators in Markov chain Monte Carlo
- Bernstein von Mises Theorems for Gaussian Regression with increasing number of regressors
- On the conditional distributions of low-dimensional projections from high-dimensional data
- PASS-GLM: polynomial approximate sufficient statistics for scalable Bayesian GLM inference
- On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding