Using Deep Learning to Improve Ensemble Smoother: Applications to Subsurface Characterization

Abstract

Ensemble smoother (ES) has been widely used in various research fields to reduce the uncertainty of the system-of-interest. However, the commonly-adopted ES method that employs the Kalman formula, that is, ES${}_{\text{(K)}}$, does not perform well when the probability distributions involved are non-Gaussian. To address this issue, we suggest to use deep learning (DL) to derive an alternative update scheme for ES in complex data assimilation applications. Here we show that the DL-based ES method, that is, ES${}_{\text{(DL)}}$, is more general and flexible. In this new update scheme, a high volume of training data are generated from a relatively small-sized ensemble of model parameters and simulation outputs, and possible non-Gaussian features can be preserved in the training data and captured by an adequate DL model. This new variant of ES is tested in two subsurface characterization problems with or without Gaussian assumptions. Results indicate that ES${}_{\text{(DL)}}$ can produce similar (in the Gaussian case) or even better (in the non-Gaussian case) results compared to those from ES${}_{\text{(K)}}$. The success of ES${}_{\text{(DL)}}$ comes from the power of DL in extracting complex (including non-Gaussian) features and learning nonlinear relationships from massive amounts of training data. Although in this work we only apply the ES${}_{\text{(DL)}}$ method in parameter estimation problems, the proposed idea can be conveniently extended to analysis of model structural uncertainty and state estimation in real-time forecasting studies.

References in corpus (12)

• A trans-disciplinary review of deep learning research for water resources scientists
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Training-image based geostatistical inversion using a spatial generative adversarial neural network
• Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identification
• Inversion using a new low-dimensional representation of complex binary geological media based on a deep neural network
• Towards a Robust Parameterization for Conditioning Facies Models Using Deep Variational Autoencoders and Ensemble Smoother
• Integration of adversarial autoencoders with residual dense convolutional networks for estimation of non-Gaussian hydraulic conductivities
• An iterative local updating ensemble smoother for estimation and uncertainty assessment of hydrologic model parameters with multimodal distributions
• Discovering state-parameter mappings in subsurface models using generative adversarial networks
• Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems with a Kalman-Inspired Proposal Distribution
• Efficient Deep Learning Techniques for Multiphase Flow Simulation in Heterogeneous Porous Media
• An Ensemble Kalman-Particle Predictor-Corrector Filter for Non-Gaussian Data Assimilation