Enforcing Deterministic Constraints on Generative Adversarial Networks for Emulating Physical Systems

Abstract

Generative adversarial networks (GANs) were initially proposed to generate images by learning from a large number of samples. Recently, GANs have been used to emulate complex physical systems such as turbulent flows. However, a critical question must be answered before GANs can be considered trusted emulators for physical systems: do GANs-generated samples conform to the various physical constraints? These include both deterministic constraints (e.g., conservation laws) and statistical constraints (e.g., energy spectrum of turbulent flows). The latter have been studied in a companion paper (Wu et al., Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems. Journal of Computational Physics. 406, 109209, 2020). In the present work, we enforce deterministic yet imprecise constraints on GANs by incorporating them into the loss function of the generator. We evaluate the performance of physics-constrained GANs on two representative tasks with geometrical constraints (generating points on circles) and differential constraints (generating divergence-free flow velocity fields), respectively. In both cases, the constrained GANs produced samples that conform to the underlying constraints rather accurately, even though the constraints are only enforced up to a specified interval. More importantly, the imposed constraints significantly accelerate the convergence and improve the robustness in the training, indicating that they serve as a physics-based regularization. These improvements are noteworthy, as the convergence and robustness are two well-known obstacles in the training of GANs.

References in corpus (9)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• DGM: A deep learning algorithm for solving partial differential equations
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Reconstruction of three-dimensional porous media using generative adversarial neural networks
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems
• MgNet: A Unified Framework of Multigrid and Convolutional Neural Network
• Constraint-Aware Neural Networks for Riemann Problems
• Enforcing constraints for interpolation and extrapolation in Generative Adversarial Networks

Cited by in corpus (6)

• Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems
• Deep Learning of Dynamic Subsurface Flow via Theory-guided Generative Adversarial Network
• Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling
• Using conditional variational autoencoders to generate images from atmospheric Cherenkov telescopes
• Physical Context and Timing Aware Sequence Generating GANs
• Investigation of Nonlinear Model Order Reduction of the Quasigeostrophic Equations through a Physics-Informed Convolutional Autoencoder