PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics

Abstract

As applications of deep learning (DL) continue to seep into critical scientific use-cases, the importance of performing uncertainty quantification (UQ) with DL has become more pressing than ever before. In scientific applications, it is also important to inform the learning of DL models with knowledge of physics of the problem to produce physically consistent and generalized solutions. This is referred to as the emerging field of physics-informed deep learning (PIDL). We consider the problem of developing PIDL formulations that can also perform UQ. To this end, we propose a novel physics-informed GAN architecture, termed PID-GAN, where the knowledge of physics is used to inform the learning of both the generator and discriminator models, making ample use of unlabeled data instances. We show that our proposed PID-GAN framework does not suffer from imbalance of generator gradients from multiple loss terms as compared to state-of-the-art. We also empirically demonstrate the efficacy of our proposed framework on a variety of case studies involving benchmark physics-based PDEs as well as imperfect physics. All the code and datasets used in this study have been made available on this link : https://github.com/arkadaw9/PID-GAN.

arXiv comment11 pages, 11 figures, 2 tables, Published at KDD 2021

References in corpus (13)

• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• Improved Training of Wasserstein GANs
• Improved Techniques for Training GANs
• Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• Understanding and mitigating gradient pathologies in physics-informed neural networks
• Blending Diverse Physical Priors with Neural Networks
• Adversarial Distillation of Bayesian Neural Network Posteriors
• The MBPEP: a deep ensemble pruning algorithm providing high quality uncertainty prediction
• Uncertainty Quantification with Generative Models
• Learning Structural Weight Uncertainty for Sequential Decision-Making

Cited by in corpus (6)

• Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art
• Physics-Informed Deep Learning For Traffic State Estimation: A Survey and the Outlook
• PI-VAE: Physics-Informed Variational Auto-Encoder for stochastic differential equations
• Bayesian Physics-Informed Extreme Learning Machine for Forward and Inverse PDE Problems with Noisy Data
• Generating artificial digital image correlation data using physics-guided adversarial networks
• Label-free timing analysis of SiPM-based modularized detectors with physics-constrained deep learning