Deep generative models in inversion: a review and development of a new approach based on a variational autoencoder

Abstract

When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological setting) of the subsurface. In such case, inversion may be formulated in a latent space where a low-dimensional parameterization of the patterns is defined and where Markov chain Monte Carlo or gradient-based methods may be applied. However, the generative mapping between the latent and the original (pixel) representations is usually highly nonlinear which may cause some difficulties for inversion, especially for gradient-based methods. In this contribution we review the conceptual framework of inversion with DGMs and study the principal causes of the nonlinearity of the generative mapping. As a result, we identify a conflict between two goals: the accuracy of the generated patterns and the feasibility of gradient-based inversion. In addition, we show how some of the training parameters of a variational autoencoder, which is a particular instance of a DGM, may be chosen so that a tradeoff between these two goals is achieved and acceptable inversion results are obtained with a stochastic gradient-descent scheme. A test case using truth models with channel patterns of different complexity and cross-borehole traveltime tomographic data involving both a linear and a nonlinear forward operator is used to assess the performance of the proposed approach.

References in corpus (24)

• Adam: A Method for Stochastic Optimization
• Auto-Encoding Variational Bayes
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Generative Adversarial Networks
• Improved Techniques for Training GANs
• Unrolled Generative Adversarial Networks
• Training-image based geostatistical inversion using a spatial generative adversarial neural network
• Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network
• Geological realism in hydrogeological and geophysical inverse modeling: a review
• Towards a Robust Parameterization for Conditioning Facies Models Using Deep Variational Autoencoders and Ensemble Smoother
• Integration of adversarial autoencoders with residual dense convolutional networks for estimation of non-Gaussian hydraulic conductivities
• Iterative ensemble smoother as an approximate solution to a regularized minimum-average-cost problem: theory and applications
• A learning-based method for solving ill-posed nonlinear inverse problems: a simulation study of Lung EIT
• Texture Synthesis with Spatial Generative Adversarial Networks
• Gradient-based deterministic inversion of geophysical data with Generative Adversarial Networks: is it feasible?
• Explorations in Homeomorphic Variational Auto-Encoding
• Metrics for Deep Generative Models
• Image synthesis with graph cuts: a fast model proposal mechanism in probabilistic inversion
• Advances in Variational Inference
• Latent Space Oddity: on the Curvature of Deep Generative Models
• The Riemannian Geometry of Deep Generative Models
• Topology of deep neural networks
• Generative Adversarial Networks for Model Order Reduction in Seismic Full-Waveform Inversion
• Data Interpolations in Deep Generative Models under Non-Simply-Connected Manifold Topology

Cited by in corpus (6)

• Deep Learning for Simultaneous Inference of Hydraulic and Transport Properties
• Continuous conditional generative adversarial networks for data-driven solutions of poroelasticity with heterogeneous material properties
• Emerging Directions in Geophysical Inversion
• A multidimensional AI-trained correction to the 1D approximate model for Airborne TDEM sensing
• Diffusion models for multivariate subsurface generation and efficient probabilistic inversion
• A new framework for experimental design using Bayesian Evidential Learning: the case of wellhead protection area