Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networks

Abstract

In this paper, we study a physics-informed algorithm for Wasserstein Generative Adversarial Networks (WGANs) for uncertainty quantification in solutions of partial differential equations. By using groupsort activation functions in adversarial network discriminators, network generators are utilized to learn the uncertainty in solutions of partial differential equations observed from the initial/boundary data. Under mild assumptions, we show that the generalization error of the computed generator converges to the approximation error of the network with high probability, when the number of samples are sufficiently taken. According to our established error bound, we also find that our physics-informed WGANs have higher requirement for the capacity of discriminators than that of generators. Numerical results on synthetic examples of partial differential equations are reported to validate our theoretical results and demonstrate how uncertainty quantification can be obtained for solutions of partial differential equations and the distributions of initial/boundary data. However, the quality or the accuracy of the uncertainty quantification theory in all the points in the interior is still the theoretical vacancy, and required for further research.

References in corpus (31)

• Adam: A Method for Stochastic Optimization
• Auto-Encoding Variational Bayes
• Neural Machine Translation by Jointly Learning to Align and Translate
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• DGM: A deep learning algorithm for solving partial differential equations
• Conditional Image Synthesis With Auxiliary Classifier GANs
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• fPINNs: Fractional Physics-Informed Neural Networks
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networks
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• Grammar as a Foreign Language
• Towards Principled Methods for Training Generative Adversarial Networks
• Neural Photo Editing with Introspective Adversarial Networks
• Generalization and Equilibrium in Generative Adversarial Nets (GANs)
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Neural Operator: Graph Kernel Network for Partial Differential Equations
• When and why PINNs fail to train: A neural tangent kernel perspective
• Convergence and Concentration of Empirical Measures under Wasserstein Distance in Unbounded Functional Spaces
• Sorting out Lipschitz function approximation
• Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory
• A Universal Approximation Theorem of Deep Neural Networks for Expressing Probability Distributions
• How Well Generative Adversarial Networks Learn Distributions
• Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs
• On the capacity of deep generative networks for approximating distributions
• Probabilistic solvers for partial differential equations
• High-Order Approximation Rates for Shallow Neural Networks with Cosine and ReLU${}^k$ Activation Functions
• On the approximation of functions by tanh neural networks

Cited by in corpus (2)

• A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic
• Bayesian Physics Informed Neural Networks for Data Assimilation and Spatio-Temporal Modelling of Wildfires