Improved Surrogate Modeling of Fluid Dynamics with Physics-Informed Neural Networks
arXiv:2105.01838
Abstract
Physics-Informed Neural Networks (PINNs) have recently shown great promise as a way of incorporating physics-based domain knowledge, including fundamental governing equations, into neural network models for many complex engineering systems. They have been particularly effective in the area of inverse problems, where boundary conditions may be ill-defined, and data-absent scenarios, where typical supervised learning approaches will fail. Here, we further explore the use of this modeling methodology to surrogate modeling of a fluid dynamical system, and demonstrate additional undiscussed and interesting advantages of such a modeling methodology over conventional data-driven approaches: 1) improving the model's predictive performance even with incomplete description of the underlying physics; 2) improving the robustness of the model to noise in the dataset; 3) reduced effort to convergence during optimization for a new, previously unseen scenario by transfer optimization of a pre-existing model. Hence, we noticed the inclusion of a physics-based regularization term can substantially improve the equivalent data-driven surrogate model in many substantive ways, including an order of magnitude improvement in test error when the dataset is very noisy, and a 2-3x improvement when only partial physics is included. In addition, we propose a novel transfer optimization scheme for use in such surrogate modeling scenarios and demonstrate an approximately 3x improvement in speed to convergence and an order of magnitude improvement in predictive performance over conventional Xavier initialization for training of new scenarios.
arXiv commentNo comment
References in corpus (15)
- DGM: A deep learning algorithm for solving partial differential equations
- Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
- NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
- B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
- Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
- Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
- Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
- Data-driven discovery of coordinates and governing equations
- A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
- A unified deep artificial neural network approach to partial differential equations in complex geometries
- Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
- Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks
- Non-invasive Inference of Thrombus Material Properties with Physics-informed Neural Networks
- Data-driven discovery of PDEs in complex datasets
- Physics-Driven Regularization of Deep Neural Networks for Enhanced Engineering Design and Analysis