Adaptive posterior distributions for uncertainty analysis of covariance matrices in Bayesian inversion problems for multioutput signals

Abstract

In this paper we address the problem of performing Bayesian inference for the parameters of a nonlinear multi-output model and the covariance matrix of the different output signals. We propose an adaptive importance sampling (AIS) scheme for multivariate Bayesian inversion problems, which is based in two main ideas: the variables of interest are split in two blocks and the inference takes advantage of known analytical optimization formulas. We estimate both the unknown parameters of the multivariate non-linear model and the covariance matrix of the noise. In the first part of the proposed inference scheme, a novel AIS technique called adaptive target adaptive importance sampling (ATAIS) is designed, which alternates iteratively between an IS technique over the parameters of the non-linear model and a frequentist approach for the covariance matrix of the noise. In the second part of the proposed inference scheme, a prior density over the covariance matrix is considered and the cloud of samples obtained by ATAIS are recycled and re-weighted to obtain a complete Bayesian study over the model parameters and covariance matrix. ATAIS is the main contribution of the work. Additionally, the inverted layered importance sampling (ILIS) is presented as a possible compelling algorithm (but based on a conceptually simpler idea). Different numerical examples show the benefits of the proposed approaches

References in corpus (8)

• Bayesian Parameter Estimation for Dynamical Models in Systems Biology
• Compressed Monte Carlo with application in particle filtering
• The Impact of the Mini-batch Size on the Variance of Gradients in Stochastic Gradient Descent
• On the safe use of prior densities for Bayesian model selection
• MCMC-driven importance samplers
• A Bayesian inference and model selection algorithm with an optimisation scheme to infer the model noise power
• R-NL: Covariance Matrix Estimation for Elliptical Distributions based on Nonlinear Shrinkage
• Joint Parameter and Parameterization Inference with Uncertainty Quantification through Differentiable Programming