Split-and-augmented Gibbs sampler - Application to large-scale inference problems

Abstract

This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction method of multipliers (ADMM) main steps. The proposed framework enables to derive faster and more efficient sampling schemes than the current state-of-the-art methods and can embed the latter. By sampling efficiently the parameter to infer as well as the hyperparameters of the problem, the generated samples can be used to approximate Bayesian estimators of the parameters to infer. Additionally, the proposed approach brings confidence intervals at a low cost contrary to optimization methods. Simulations on two often-studied signal processing problems illustrate the performance of the two proposed samplers. All results are compared to those obtained by recent state-of-the-art optimization and MCMC algorithms used to solve these problems.

References in corpus (10)

• Fast Image Recovery Using Variable Splitting and Constrained Optimization
• Bayes in the sky: Bayesian inference and model selection in cosmology
• Robust parameter estimation for compact binaries with ground-based gravitational-wave observations using the LALInference software library
• An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems
• Hyperspectral unmixing with spectral variability using a perturbed linear mixing model
• A Survey of Stochastic Simulation and Optimization Methods in Signal Processing
• Efficient Gaussian Sampling for Solving Large-Scale Inverse Problems using MCMC Methods
• Bayesian anti-sparse coding
• Gradient Scan Gibbs Sampler: an efficient algorithm for high-dimensional Gaussian distributions
• Global consensus Monte Carlo

Cited by in corpus (6)

• High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm
• Optimized Population Monte Carlo
• Asymptotically exact data augmentation: models, properties and algorithms
• Efficient MCMC Sampling with Dimension-Free Convergence Rate using ADMM-type Splitting
• A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems
• PhyDiCT: Plug-and-Play CT Reconstruction from Sparse X-Rays via Differentiable Rendering and Strong Priors