Fast, Scalable Approximations to Posterior Distributions in Extended Latent Gaussian Models

Abstract

We define a novel class of additive models, called Extended Latent Gaussian Models, that allow for a wide range of response distributions and flexible relationships between the additive predictor and mean response. The new class covers a broad range of interesting models including multi-resolution spatial processes, partial likelihood-based survival models, and multivariate measurement error models. Because computation of the exact posterior distribution is infeasible, we develop a fast, scalable approximate Bayesian inference methodology for this class based on nested Gaussian, Laplace, and adaptive quadrature approximations. We prove that the error in these approximate posteriors is op(1) under standard conditions, and provide numerical evidence suggesting that our method runs faster and scales to larger datasets than methods based on Integrated Nested Laplace Approximations and Markov Chain Monte Carlo, with comparable accuracy. We apply the new method to the mapping of malaria incidence rates in continuous space using aggregated data, mapping leukaemia survival hazards using a Cox Proportional-Hazards model with a continuously-varying spatial process, and estimating the mass of the Milky Way Galaxy using noisy multivariate measurements of the positions and velocities of star clusters in its orbit.

References in corpus (9)

• Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
• Variational Inference: A Review for Statisticians
• Smoothing parameter and model selection for general smooth models
• TMB: Automatic Differentiation and Laplace Approximation
• Spatial and Spatio-Temporal Log-Gaussian Cox Processes: Extending the Geostatistical Paradigm
• The cumulative mass profile of the Milky Way as determined by globular cluster kinematics from Gaia DR2
• Bayesian Mass Estimates of the Milky Way II: The dark and light sides of parameter assumptions
• Bayesian Mass Estimates of the Milky Way: including measurement uncertainties with hierarchical Bayes
• Estimating the Milky Way's Mass via Hierarchical Bayes: A Blind Test on MUGS2 Simulated Galaxies

Cited by in corpus (3)

• Approximating Bayes in the 21st Century
• Implementing Approximate Bayesian Inference using Adaptive Quadrature: the aghq Package
• Stochastic Convergence Rates and Applications of Adaptive Quadrature in Bayesian Inference