Non-linear regression models for Approximate Bayesian Computation

Abstract

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the curse of dimensionality when the number of summary statistics is increased. Here we propose a machine-learning approach to the estimation of the posterior density by introducing two innovations. The new method fits a nonlinear conditional heteroscedastic regression of the parameter on the summary statistics, and then adaptively improves estimation using importance sampling. The new algorithm is compared to the state-of-the-art approximate Bayesian methods, and achieves considerable reduction of the computational burden in two examples of inference in statistical genetics and in a queueing model.

4 figures; version 3 minor changes; to appear in Statistics and Computing

References in corpus (3)

• Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
• Adaptive approximate Bayesian computation
• Approximate Bayesian computation (ABC) gives exact results under the assumption of model error

Cited by in corpus (78)

• A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
• Approximate Bayesian computation (ABC) gives exact results under the assumption of model error
• Adaptive approximate Bayesian computation for complex models
• Stochastic epidemics in a homogeneous community
• Statistical inference for epidemic processes in a homogeneous community (Part IV of the book Stochastic Epidemic Models and Inference)
• Stochastic epidemics in a heterogeneous community (Part III of the book Stochastic Epidemic Models and Inference)
• Likelihood-Free Cosmological Inference with Type Ia Supernovae: Approximate Bayesian Computation for a Complete Treatment of Uncertainty
• Flexible statistical inference for mechanistic models of neural dynamics
• HIV with contact-tracing: a case study in Approximate Bayesian Computation
• Likelihood-free Markov chain Monte Carlo
• Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows
• Inference for SDE models via Approximate Bayesian Computation
• Sequential Monte Carlo with Adaptive Weights for Approximate Bayesian Computation
• A Likelihood-Free Inference Framework for Population Genetic Data using Exchangeable Neural Networks
• Pre-processing for approximate Bayesian computation in image analysis
• Constructing Summary Statistics for Approximate Bayesian Computation: Semi-automatic ABC
• Efficient acquisition rules for model-based approximate Bayesian computation
• ABC-CDE: Towards Approximate Bayesian Computation with Complex High-Dimensional Data and Limited Simulations
• An Improved Approximate-Bayesian Model-choice Method for Estimating Shared Evolutionary History
• Overview of Approximate Bayesian Computation
• Summary Statistics in Approximate Bayesian Computation
• Benchmarking Simulation-Based Inference
• Approximating Bayes in the 21st Century
• The impact of temporal sampling resolution on parameter inference for biological transport models
• On Bayesian inference for the M/G/1 queue with efficient MCMC sampling
• Indirect inference through prediction
• Goodness-of-fit statistics for approximate Bayesian computation
• Cosmological Parameter Estimation and Inference using Deep Summaries
• Bayesian computation: a perspective on the current state, and sampling backwards and forwards
• ABCpy: A High-Performance Computing Perspective to Approximate Bayesian Computation
• Optimization Monte Carlo: Efficient and Embarrassingly Parallel Likelihood-Free Inference
• A Preferential Attachment Model for the Stellar Initial Mass Function
• Marginally-calibrated deep distributional regression
• Simulation-Based Inference Benchmark for Weak Lensing Cosmology
• Multi-Component Imaging of the Fermi Gamma-ray Sky in the Spatio-spectral Domain
• On the Asymptotic Efficiency of Approximate Bayesian Computation Estimators
• Neural Density Estimation and Likelihood-free Inference
• Calibration of a bumble bee foraging model using Approximate Bayesian Computation
• Robust and Efficient Approximate Bayesian Computation: A Minimum Distance Approach
• Approximate Bayesian Computation by Modelling Summary Statistics in a Quasi-likelihood Framework
• Robust Bayesian Synthetic Likelihood via a Semi-Parametric Approach
• Optimizing Threshold - Schedules for Approximate Bayesian Computation Sequential Monte Carlo Samplers: Applications to Molecular Systems
• Robust Approximate Bayesian Computation: An Adjustment Approach
• Approximate Bayesian computation and Bayes linear analysis: Towards high-dimensional ABC
• Guided sequential ABC schemes for intractable Bayesian models
• Fast Approximate Bayesian Computation for discretely observed Markov models using a factorised posterior distribution
• Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model
• Likelihood-free parameter estimation for dynamic queueing networks: case study of passenger flow in an international airport terminal
• Gaussian process modeling in approximate Bayesian computation to estimate horizontal gene transfer in bacteria
• Deviance Information Criteria for Model Selection in Approximate Bayesian Computation
• Regression approaches for Approximate Bayesian Computation
• Approximate Bayesian Computation: a nonparametric perspective
• Simulation-based model selection for dynamical systems in systems and population biology
• AABC: approximate approximate Bayesian computation when simulating a large number of data sets is computationally infeasible
• Semi-automatic selection of summary statistics for ABC model choice
• A Bayesian approach for the analysis of error rate studies in forensic science
• Approximate Bayesian Computation Based on Maxima Weighted Isolation Kernel Mapping
• Assessment and adjustment of approximate inference algorithms using the law of total variance
• abc: an R package for Approximate Bayesian Computation (ABC)
• Robust Optimisation Monte Carlo
• Emulating a gravity model to infer the spatiotemporal dynamics of an infectious disease
• A review of Approximate Bayesian Computation methods via density estimation: inference for simulator-models
• Likelihood-free approximate Gibbs sampling
• Variational Auto-Encoder Based Approximate Bayesian Computation Uncertian Inverse Method for Sheet Metal Forming Problem
• Kernel-based Approximate Bayesian Inference for Exponential Family Random Graph Models
• Statistical modeling for adaptive trait evolution in randomly evolving environment
• Recalibration: A post-processing method for approximate Bayesian computation
• Quantification of the weight of fingerprint evidence using a ROC-based Approximate Bayesian Computation algorithm for model selection
• Functional regression approximate Bayesian computation for Gaussian process density estimation
• Flexible online multivariate regression with variational Bayes and the matrix-variate Dirichlet process
• Parameter Exploration in Simulation Experiments: A Bayesian Framework
• Bayesian Computational Tools
• Forward Amortized Inference for Likelihood-Free Variational Marginalization
• Detecting conflicting summary statistics in likelihood-free inference
• A simple recipe for making accurate parametric inference in finite sample
• Likelihood-Free Parallel Tempering
• Approximate Bayesian inference for a "steps and turns" continuous-time random walk observed at regular time intervals
• Network Inference from a Link-Traced Sample using Approximate Bayesian Computation