Accelerating Physics-Informed Neural Network Training with Prior Dictionaries

Abstract

Physics-Informed Neural Networks (PINNs) can be regarded as general-purpose PDE solvers, but it might be slow to train PINNs on particular problems, and there is no theoretical guarantee of corresponding error bounds. In this manuscript, we propose a variant called Prior Dictionary based Physics-Informed Neural Networks (PD-PINNs). Equipped with task-dependent dictionaries, PD-PINNs enjoy enhanced representation power on the tasks, which helps to capture features provided by dictionaries so that the proposed neural networks can achieve faster convergence in the process of training. In various numerical simulations, compared with existing PINN methods, combining prior dictionaries can significantly enhance convergence speed. In terms of theory, we obtain the error bounds applicable to PINNs and PD-PINNs for solving elliptic partial differential equations of second order. It is proved that under certain mild conditions, the prediction error made by neural networks can be bounded by expected loss of PDEs and boundary conditions.

References in corpus (4)

• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
• A convex model for non-negative matrix factorization and dimensionality reduction on physical space

Cited by in corpus (9)

• Multi-Objective Loss Balancing for Physics-Informed Deep Learning
• A novel meta-learning initialization method for physics-informed neural networks
• Active Training of Physics-Informed Neural Networks to Aggregate and Interpolate Parametric Solutions to the Navier-Stokes Equations
• Data vs. Physics: The Apparent Pareto Front of Physics-Informed Neural Networks
• Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)
• An extended physics informed neural network for preliminary analysis of parametric optimal control problems
• ModalPINN: an extension of Physics-Informed Neural Networks with enforced truncated Fourier decomposition for periodic flow reconstruction using a limited number of imperfect sensors
• NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework
• An Upper Limit of Decaying Rate with Respect to Frequency in Deep Neural Network