Physics-Informed Neural Operator for Learning Partial Differential Equations

Abstract

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first hybrid approach incorporating data and PDE constraints at different resolutions to learn the operator. Specifically, in PINO, we combine coarse-resolution training data with PDE constraints imposed at a higher resolution. The resulting PINO model can accurately approximate the ground-truth solution operator for many popular PDE families and shows no degradation in accuracy even under zero-shot super-resolution, i.e., being able to predict beyond the resolution of training data. PINO uses the Fourier neural operator (FNO) framework that is guaranteed to be a universal approximator for any continuous operator and discretization-convergent in the limit of mesh refinement. By adding PDE constraints to FNO at a higher resolution, we obtain a high-fidelity reconstruction of the ground-truth operator. Moreover, PINO succeeds in settings where no training data is available and only PDE constraints are imposed, while previous approaches, such as the Physics-Informed Neural Network (PINN), fail due to optimization challenges, e.g., in multi-scale dynamic systems such as Kolmogorov flows.

References in corpus (19)

• DeepXDE: A deep learning library for solving differential equations
• DGM: A deep learning algorithm for solving partial differential equations
• Solving high-dimensional partial differential equations using deep learning
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Fourier Neural Operator for Parametric Partial Differential Equations
• Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data
• Machine learning accelerated computational fluid dynamics
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• 86 PFLOPS Deep Potential Molecular Dynamics simulation of 100 million atoms with ab initio accuracy
• Neural Operator: Graph Kernel Network for Partial Differential Equations
• Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solvers
• When and why PINNs fail to train: A neural tangent kernel perspective
• A physics-informed operator regression framework for extracting data-driven continuum models
• HypoSVI: Hypocenter inversion with Stein variational inference and Physics Informed Neural Networks
• Physics-informed neural networks (PINNs) for fluid mechanics: A review
• Learning to Optimize Multigrid PDE Solvers
• A multiscale neural network based on hierarchical matrices
• Data-informed Deep Optimization

Cited by in corpus (24)

• Tackling the Curse of Dimensionality with Physics-Informed Neural Networks
• Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review
• Long-term predictions of turbulence by implicit U-Net enhanced Fourier neural operator
• Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics
• Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems
• Improved generalization with deep neural operators for engineering systems: Path towards digital twin
• Finite Volume Graph Network(FVGN): Predicting unsteady incompressible fluid dynamics with finite volume informed neural network
• CEENs: Causality-enforced evolutional networks for solving time-dependent partial differential equations
• Learning Physical Models that Can Respect Conservation Laws
• Magnetohydrodynamics with Physics Informed Neural Operators
• Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations
• Comparison of Neural FEM and Neural Operator Methods for applications in Solid Mechanics
• Spectrally Adapted Physics-Informed Neural Networks for Solving Unbounded Domain Problems
• Deep learning for nano-photonic materials -- The solution to everything!?
• On the locality of local neural operator in learning fluid dynamics
• Residual-Based Error Corrector Operator to Enhance Accuracy and Reliability of Neural Operator Surrogates of Nonlinear Variational Boundary-Value Problems
• Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
• Local neural operator for solving transient partial differential equations on varied domains
• Quantum DeepONet: Neural operators accelerated by quantum computing
• Physics-Guided Learning of Meteorological Dynamics for Weather Downscaling and Forecasting
• Rapidly Encoding Generalizable Dynamics in a Euclidean Symmetric Neural Network
• Diffusion models as probabilistic neural operators for recovering unobserved states of dynamical systems
• Deep Learning-Based Prediction of High Explosive Induced Fluid Dynamics
• Evolving Generalizable Multigrid-Based Helmholtz Preconditioners with Grammar-Guided Genetic Programming