LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry

Abstract

We present a novel loss formulation for efficient learning of complex dynamics from governing physics, typically described by partial differential equations (PDEs), using physics-informed neural networks (PINNs). In our experiments, existing versions of PINNs are seen to learn poorly in many problems, especially for complex geometries, as it becomes increasingly difficult to establish appropriate sampling strategy at the near boundary region. Overly dense sampling can adversely impede training convergence if the local gradient behaviors are too complex to be adequately modelled by PINNs. On the other hand, if the samples are too sparse, existing PINNs tend to overfit the near boundary region, leading to incorrect solution. To prevent such issues, we propose a new Boundary Connectivity (BCXN) loss function which provides linear local structure approximation (LSA) to the gradient behaviors at the boundary for PINN. Our BCXN-loss implicitly imposes local structure during training, thus facilitating fast physics-informed learning across entire problem domains with order of magnitude sparser training samples. This LSA-PINN method shows a few orders of magnitude smaller errors than existing methods in terms of the standard L2-norm metric, while using dramatically fewer training samples and iterations. Our proposed LSA-PINN does not pose any requirement on the differentiable property of the networks, and we demonstrate its benefits and ease of implementation on both multi-layer perceptron and convolutional neural network versions as commonly used in current PINN literature.

11 pages, 7 figures

References in corpus (16)

• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations
• CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Method
• Efficient training of physics-informed neural networks via importance sampling
• A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equations
• Hybrid FEM-NN models: Combining artificial neural networks with the finite element method
• Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism
• SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs
• Learning in Sinusoidal Spaces with Physics-Informed Neural Networks
• Teaching the Incompressible Navier-Stokes Equations to Fast Neural Surrogate Models in 3D
• Physics-aware deep neural networks for surrogate modeling of turbulent natural convection
• Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations
• Machine Learning For Elliptic PDEs: Fast Rate Generalization Bound, Neural Scaling Law and Minimax Optimality

Cited by in corpus (1)

• Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities