Bayesian Inference with Generative Adversarial Network Priors

Abstract

Bayesian inference is used extensively to infer and to quantify the uncertainty in a field of interest from a measurement of a related field when the two are linked by a physical model. Despite its many applications, Bayesian inference faces challenges when inferring fields that have discrete representations of large dimension, and/or have prior distributions that are difficult to represent mathematically. In this manuscript we consider the use of Generative Adversarial Networks (GANs) in addressing these challenges. A GAN is a type of deep neural network equipped with the ability to learn the distribution implied by multiple samples of a given field. Once trained on these samples, the generator component of a GAN maps the iid components of a low-dimensional latent vector to an approximation of the distribution of the field of interest. In this work we demonstrate how this approximate distribution may be used as a prior in a Bayesian update, and how it addresses the challenges associated with characterizing complex prior distributions and the large dimension of the inferred field. We demonstrate the efficacy of this approach by applying it to the problem of inferring and quantifying uncertainty in the initial temperature field in a heat conduction problem from a noisy measurement of the temperature at later time.

References in corpus (12)

• Deep Residual Learning for Image Recognition
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• MaskGAN: Better Text Generation via Filling in the______
• Compressed Sensing using Generative Models
• Scalable and efficient algorithms for the propagation of uncertainty from data through inference to prediction for large-scale problems, with application to flow of the Antarctic ice sheet
• Deep Bayesian Inversion
• Deep Compressed Sensing
• Task-Aware Compressed Sensing with Generative Adversarial Networks
• An Unsupervised Approach to Solving Inverse Problems using Generative Adversarial Networks

Cited by in corpus (4)

• Solving Bayesian Inverse Problems via Variational Autoencoders
• Generative Adversarial Networks Applied to Synthetic Financial Scenarios Generation
• A workflow for seismic imaging with quantified uncertainty
• Application of Deep Learning-based Interpolation Methods to Nearshore Bathymetry