Physics-informed radial basis network (PIRBN): A local approximating neural network for solving nonlinear PDEs

Abstract

Our recent intensive study has found that physics-informed neural networks (PINN) tend to be local approximators after training. This observation leads to this novel physics-informed radial basis network (PIRBN), which can maintain the local property throughout the entire training process. Compared to deep neural networks, a PIRBN comprises of only one hidden layer and a radial basis "activation" function. Under appropriate conditions, we demonstrated that the training of PIRBNs using gradient descendent methods can converge to Gaussian processes. Besides, we studied the training dynamics of PIRBN via the neural tangent kernel (NTK) theory. In addition, comprehensive investigations regarding the initialisation strategies of PIRBN were conducted. Based on numerical examples, PIRBN has been demonstrated to be more effective and efficient than PINN in solving PDEs with high-frequency features and ill-posed computational domains. Moreover, the existing PINN numerical techniques, such as adaptive learning, decomposition and different types of loss functions, are applicable to PIRBN. The programs that can regenerate all numerical results can be found at https://github.com/JinshuaiBai/PIRBN.

arXiv comment48 pages, 26 figures

References in corpus (25)

• Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
• DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics
• An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications
• Neural Tangent Kernel: Convergence and Generalization in Neural Networks
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Physics-informed neural networks for inverse problems in nano-optics and metamaterials
• Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks
• Deep Autoencoder based Energy Method for the Bending, Vibration, and Buckling Analysis of Kirchhoff Plates
• Flow over an espresso cup: Inferring 3D velocity and pressure fields from tomographic background oriented schlieren videos via physics-informed neural networks
• Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
• A Physics-Guided Neural Network Framework for Elastic Plates: Comparison of Governing Equations-Based and Energy-Based Approaches
• Physics informed neural networks for continuum micromechanics
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• Understanding and mitigating gradient pathologies in physics-informed neural networks
• Non-invasive Inference of Thrombus Material Properties with Physics-informed Neural Networks
• Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems
• Biologically-informed neural networks guide mechanistic modeling from sparse experimental data
• The Neural Particle Method -- An Updated Lagrangian Physics Informed Neural Network for Computational Fluid Dynamics
• A nonlocal physics-informed deep learning framework using the peridynamic differential operator
• SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs
• Why Spectral Normalization Stabilizes GANs: Analysis and Improvements
• Utilising physics-guided deep learning to overcome data scarcity

Cited by in corpus (4)

• Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networks
• Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?
• Are Two Hidden Layers Still Enough for the Physics-Informed Neural Networks?
• An efficient wavelet-based physics-informed neural network for multiscale problems