VarNet: Variational Neural Networks for the Solution of Partial Differential Equations

Abstract

In this paper we propose a new model-based unsupervised learning method, called VarNet, for the solution of partial differential equations (PDEs) using deep neural networks (NNs). Particularly, we propose a novel loss function that relies on the variational (integral) form of PDEs as apposed to their differential form which is commonly used in the literature. Our loss function is discretization-free, highly parallelizable, and more effective in capturing the solution of PDEs since it employs lower-order derivatives and trains over measure non-zero regions of space-time. Given this loss function, we also propose an approach to optimally select the space-time samples, used to train the NN, that is based on the feedback provided from the PDE residual. The models obtained using VarNet are smooth and do not require interpolation. They are also easily differentiable and can directly be used for control and optimization of PDEs. Finally, VarNet can straight-forwardly incorporate parametric PDE models making it a natural tool for model order reduction (MOR) of PDEs. We demonstrate the performance of our method through extensive numerical experiments for the advection-diffusion PDE as an important case-study.

arXiv comment15 pages, 27 figures

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• DGM: A deep learning algorithm for solving partial differential equations
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• PDE-Net: Learning PDEs from Data
• Distributed State Estimation Using Intermittently Connected Robot Networks
• Physics-Based Learning for Robotic Environmental Sensing

Cited by in corpus (10)

• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Physics-Informed Neural Network Method for Forward and Backward Advection-Dispersion Equations
• Variational Physics Informed Neural Networks: the role of quadratures and test functions
• Error estimates of residual minimization using neural networks for linear PDEs
• A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
• Bayesian neural networks for weak solution of PDEs with uncertainty quantification
• Deep Learning for Robotic Mass Transport Cloaking
• A Neural Solver for Variational Problems on CAD Geometries with Application to Electric Machine Simulation
• Learning To Estimate Regions Of Attraction Of Autonomous Dynamical Systems Using Physics-Informed Neural Networks