Deep Learning of Subsurface Flow via Theory-guided Neural Network

Abstract

Active researches are currently being performed to incorporate the wealth of scientific knowledge into data-driven approaches (e.g., neural networks) in order to improve the latter's effectiveness. In this study, the Theory-guided Neural Network (TgNN) is proposed for deep learning of subsurface flow. In the TgNN, as supervised learning, the neural network is trained with available observations or simulation data while being simultaneously guided by theory (e.g., governing equations, other physical constraints, engineering controls, and expert knowledge) of the underlying problem. The TgNN can achieve higher accuracy than the ordinary Artificial Neural Network (ANN) because the former provides physically feasible predictions and can be more readily generalized beyond the regimes covered with the training data. Furthermore, the TgNN model is proposed for subsurface flow with heterogeneous model parameters. Several numerical cases of two-dimensional transient saturated flow are introduced to test the performance of the TgNN. In the learning process, the loss function contains data mismatch, as well as PDE constraint, engineering control, and expert knowledge. After obtaining the parameters of the neural network by minimizing the loss function, a TgNN model is built that not only fits the data, but also adheres to physical/engineering constraints. Predicting the future response can be easily realized by the TgNN model. In addition, the TgNN model is tested in more complicated scenarios, such as prediction with changed boundary conditions, learning from noisy data or outliers, transfer learning, and engineering controls. Numerical results demonstrate that the TgNN model achieves much better predictability, reliability, and generalizability than ANN models due to the physical/engineering constraints in the former.

References in corpus (15)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: A system for large-scale machine learning
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• A trans-disciplinary review of deep learning research for water resources scientists
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Training-image based geostatistical inversion using a spatial generative adversarial neural network
• Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous media
• Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling
• Deep autoregressive neural networks for high-dimensional inverse problems in groundwater contaminant source identification
• Simulator-free Solution of High-Dimensional Stochastic Elliptic Partial Differential Equations using Deep Neural Networks
• Discovering state-parameter mappings in subsurface models using generative adversarial networks
• LaneNet: Real-Time Lane Detection Networks for Autonomous Driving
• Deep Learning Based Automatic Video Annotation Tool for Self-Driving Car

Cited by in corpus (28)

• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Differentiable modeling to unify machine learning and physical models and advance Geosciences
• Predicting and Mapping of Soil Organic Carbon Using Machine Learning Algorithms in Northern Iran
• Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning method
• A Gradient-based Deep Neural Network Model for Simulating Multiphase Flow in Porous Media
• Deep-Learning based Inverse Modeling Approaches: A Subsurface Flow Example
• Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)
• Efficient Uncertainty Quantification for Dynamic Subsurface Flow with Surrogate by Theory-guided Neural Network
• Theory-guided Auto-Encoder for Surrogate Construction and Inverse Modeling
• Weak Form Theory-guided Neural Network (TgNN-wf) for Deep Learning of Subsurface Single and Two-phase Flow
• Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
• Use of Multifidelity Training Data and Transfer Learning for Efficient Construction of Subsurface Flow Surrogate Models
• Depression Detection Using Digital Traces on Social Media: A Knowledge-aware Deep Learning Approach
• Time Series Predictions in Unmonitored Sites: A Survey of Machine Learning Techniques in Water Resources
• A Lagrangian Dual-based Theory-guided Deep Neural Network
• Inferring electrochemical performance and parameters of Li-ion batteries based on deep operator networks
• Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework
• Deep Learning of Dynamic Subsurface Flow via Theory-guided Generative Adversarial Network
• Uncertainty quantification of two-phase flow in porous media via coupled-TgNN surrogate model
• Physics-constrained indirect supervised learning
• Finite Volume Neural Network: Modeling Subsurface Contaminant Transport
• Physics-informed Convolutional Neural Networks for Temperature Field Prediction of Heat Source Layout without Labeled Data
• Identification of Physical Processes and Unknown Parameters of 3D Groundwater Contaminant Problems via Theory-guided U-net
• Robust discovery of partial differential equations in complex situations
• Physics-Guided Discovery of Highly Nonlinear Parametric Partial Differential Equations
• Modelling of daily reference evapotranspiration using deep neural network in different climates
• Generalized Global Self-Optimizing Control for Chemical Processes: Part II Objective-Guided Controlled Variable Learning Approach
• Transfer Learning Approaches for Knowledge Discovery in Grid-based Geo-Spatiotemporal Data