Multilevel domain decomposition-based architectures for physics-informed neural networks

Abstract

Physics-informed neural networks (PINNs) are a powerful approach for solving problems involving differential equations, yet they often struggle to solve problems with high frequency and/or multi-scale solutions. Finite basis physics-informed neural networks (FBPINNs) improve the performance of PINNs in this regime by combining them with an overlapping domain decomposition approach. In this work, FBPINNs are extended by adding multiple levels of domain decompositions to their solution ansatz, inspired by classical multilevel Schwarz domain decomposition methods (DDMs). Analogous to typical tests for classical DDMs, we assess how the accuracy of PINNs, FBPINNs and multilevel FBPINNs scale with respect to computational effort and solution complexity by carrying out strong and weak scaling tests. Our numerical results show that the proposed multilevel FBPINNs consistently and significantly outperform PINNs across a range of problems with high frequency and multi-scale solutions. Furthermore, as expected in classical DDMs, we show that multilevel FBPINNs improve the accuracy of FBPINNs when using large numbers of subdomains by aiding global communication between subdomains.

arXiv comment42 pages, 12 figures

References in corpus (24)

• Adam: A Method for Stochastic Optimization
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• Physics-informed neural networks for inverse problems in nano-optics and metamaterials
• Physics-informed learning of governing equations from scarce data
• Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
• Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations
• Flow over an espresso cup: Inferring 3D velocity and pressure fields from tomographic background oriented schlieren videos via physics-informed neural networks
• On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• Physics Informed Neural Networks for Simulating Radiative Transfer
• Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology
• D3M: A deep domain decomposition method for partial differential equations
• Distributed physics informed neural network for data-efficient solution to partial differential equations
• The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies
• Deep Theory of Functional Connections: A New Method for Estimating the Solutions of PDEs
• Finite basis physics-informed neural networks as a Schwarz domain decomposition method

Cited by in corpus (10)

• Exploring spectropolarimetric inversions using neural fields. Solar chromospheric magnetic field under the weak-field approximation
• A multifidelity approach to continual learning for physical systems
• A Practitioner's Guide to Kolmogorov-Arnold Networks
• An overlapping domain decomposition method for the solution of parametric elliptic problems via proper generalized decomposition
• An operator preconditioning perspective on training in physics-informed machine learning
• A Nonoverlapping Domain Decomposition Method for Extreme Learning Machines: Elliptic Problems
• An approximate Riemann solver approach in Physics-Informed Neural Networks for hyperbolic conservation laws
• A Neumann-Neumann Acceleration with Coarse Space for Domain Decomposition of Extreme Learning Machines
• Neural semi-Lagrangian method for high-dimensional advection-diffusion problems
• Regime-Aware Time Weighting for Physics-Informed Neural Networks