hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition

Abstract

We formulate a general framework for hp-variational physics-informed neural networks (hp-VPINNs) based on the nonlinear approximation of shallow and deep neural networks and hp-refinement via domain decomposition and projection onto space of high-order polynomials. The trial space is the space of neural network, which is defined globally over the whole computational domain, while the test space contains the piecewise polynomials. Specifically in this study, the hp-refinement corresponds to a global approximation with local learning algorithm that can efficiently localize the network parameter optimization. We demonstrate the advantages of hp-VPINNs in accuracy and training cost for several numerical examples of function approximation and solving differential equations.

References in corpus (29)

• Adam: A Method for Stochastic Optimization
• TensorFlow: A system for large-scale machine learning
• DeepXDE: A deep learning library for solving differential equations
• DGM: A deep learning algorithm for solving partial differential equations
• An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• fPINNs: Fractional Physics-Informed Neural Networks
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Weak Adversarial Networks for High-dimensional Partial Differential Equations
• SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
• Variational Physics-Informed Neural Networks For Solving Partial Differential Equations
• Understanding and mitigating gradient pathologies in physics-informed neural networks
• A penalty method for PDE-constrained optimization in inverse problems
• Deep Nitsche Method: Deep Ritz Method with Essential Boundary Conditions
• D3M: A deep domain decomposition method for partial differential equations
• Nonlinear Approximation and (Deep) ReLU Networks
• Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations
• Nonlinear Approximation Using Gaussian Kernels
• Error estimates of residual minimization using neural networks for linear PDEs
• VarNet: Variational Neural Networks for the Solution of Partial Differential Equations
• Physics Constrained Learning for Data-driven Inverse Modeling from Sparse Observations
• Greedy Deep Dictionary Learning
• Inverse Modeling of Viscoelasticity Materials using Physics Constrained Learning
• Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpoint
• Function approximation by deep networks

Cited by in corpus (96)

• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Uncertainty Quantification in Scientific Machine Learning: Methods, Metrics, and Comparisons
• SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
• Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations
• Physics-Informed Neural Network for Modelling the Thermochemical Curing Process of Composite-Tool Systems During Manufacture
• Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems
• Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
• Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networks
• Non-invasive Inference of Thrombus Material Properties with Physics-informed Neural Networks
• A two-stage physics-informed neural network method based on conserved quantities and applications in localized wave solutions
• Multi-Objective Loss Balancing for Physics-Informed Deep Learning
• Deep Learning in Deterministic Computational Mechanics
• Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology
• A nonlocal physics-informed deep learning framework using the peridynamic differential operator
• Meta-learning PINN loss functions
• Deep learning of free boundary and Stefan problems
• Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domains
• CENN: Conservative energy method based on neural networks with subdomains for solving variational problems involving heterogeneous and complex geometries
• Physics-informed radial basis network (PIRBN): A local approximating neural network for solving nonlinear PDEs
• A novel meta-learning initialization method for physics-informed neural networks
• Solving Forward and Inverse Problems of Contact Mechanics using Physics-Informed Neural Networks
• Variational Onsager Neural Networks (VONNs): A thermodynamics-based variational learning strategy for non-equilibrium PDEs
• Integrated Finite Element Neural Network (I-FENN) for non-local continuum damage mechanics
• Variational Physics Informed Neural Networks: the role of quadratures and test functions
• Physics-informed neural networks (PINNs) for fluid mechanics: A review
• Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics
• Physics-informed neural network methods based on Miura transformations and discovery of new localized wave solutions
• Weak Form Theory-guided Neural Network (TgNN-wf) for Deep Learning of Subsurface Single and Two-phase Flow
• Enforcing Dirichlet boundary conditions in physics-informed neural networks and variational physics-informed neural networks
• Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
• BINN: A deep learning approach for computational mechanics problems based on boundary integral equations
• Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow models
• Mosaic Flows: A Transferable Deep Learning Framework for Solving PDEs on Unseen Domains
• Adaptive deep density approximation for Fokker-Planck equations
• Multi-Output Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Uncertainties
• Finite element interpolated neural networks for solving forward and inverse problems
• DCEM: A deep complementary energy method for solid mechanics
• Combining physics-based and data-driven models: advancing the frontiers of research with Scientific Machine Learning
• Neural parameter calibration for large-scale multi-agent models
• An extended physics informed neural network for preliminary analysis of parametric optimal control problems
• Physics-informed neural networks for predicting gas flow dynamics and unknown parameters in diesel engines
• Energy-based error bound of physics-informed neural network solutions in elasticity
• Error estimates of residual minimization using neural networks for linear PDEs
• HomPINNs: homotopy physics-informed neural networks for solving the inverse problems of nonlinear differential equations with multiple solutions
• Predicting nonlinear dynamics of optical solitons in optical fiber via the SCPINN
• NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework
• Physics-informed neural networks for inverse problems in supersonic flows
• Physics-integrated hybrid framework for model form error identification in nonlinear dynamical systems
• Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks
• Physics-Informed Deep Learning of Rate-and-State Fault Friction
• A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiency
• A Deep Double Ritz Method (D${}^2$RM) for solving Partial Differential Equations using Neural Networks
• Learning thermoacoustic interactions in combustors using a physics-informed neural network
• Learning characteristic parameters and dynamics of centrifugal pumps under multiphase flow using physics-informed neural networks
• Deep learning for solution and inversion of structural mechanics and vibrations
• Bayesian neural networks for weak solution of PDEs with uncertainty quantification
• Tensor-decomposition-based A Priori Surrogate (TAPS) modeling for ultra large-scale simulations
• Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learnings
• Invariant deep neural networks under the finite group for solving partial differential equations
• Optimizing Variational Physics-Informed Neural Networks Using Least Squares
• Convergence rate of DeepONets for learning operators arising from advection-diffusion equations
• Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning
• On the locality of local neural operator in learning fluid dynamics
• The mixed deep energy method for resolving concentration features in finite strain hyperelasticity
• Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
• Self-Adaptive Physics-Informed Quantum Machine Learning for Solving Differential Equations
• Meshfree Variational Physics Informed Neural Networks (MF-VPINN): an adaptive training strategy
• Splitting physics-informed neural networks for inferring the dynamics of integer- and fractional-order neuron models
• Learning of viscosity functions in rarefied gas flows with physics-informed neural networks
• Discovering Physics-Informed Neural Networks Model for Solving Partial Differential Equations through Evolutionary Computation
• Variational PINNs with tree-based integration and boundary element data in the modeling of multi-phase architected materials
• Are Two Hidden Layers Still Enough for the Physics-Informed Neural Networks?
• Preconditioned FEM-based Neural Networks for Solving Incompressible Fluid Flows and Related Inverse Problems
• Compatible finite element interpolated neural networks
• About optimal loss function for training physics-informed neural networks under respecting causality
• Numerical simulation of transient heat conduction with moving heat source using Physics Informed Neural Networks
• An efficient wavelet-based physics-informed neural network for multiscale problems
• A Neural Solver for Variational Problems on CAD Geometries with Application to Electric Machine Simulation
• A composable autoencoder-based iterative algorithm for accelerating numerical simulations
• Runge-Kutta Physics Informed Neural Networks: Formulation and Analysis
• An $r$-adaptive finite element method using neural networks for parametric self-adjoint elliptic problem
• PGD-based local surrogate models via overlapping domain decomposition: a computational comparison
• Modified physics-informed neural network method based on the conservation law constraint and its prediction of optical solitons
• A Physics-Informed Neural Network Framework For Partial Differential Equations on 3D Surfaces: Time-Dependent Problems
• Unfitted finite element interpolated neural networks
• Differentiable Spline Approximations
• Physics-Infused Neural MPC of a DC-DC Boost Converter with Adaptive Transient Recovery and Enhanced Dynamic Stability
• A physics-aware deep learning model for shear band formation around collapsing pores in shocked reactive materials
• Parameter Estimation and Adaptive Solution of the Leray-Burgers Equation Using Physics-Informed Neural Networks
• Machine-learning custom-made basis functions for partial differential equations
• Neural network methods for Neumann series problems of Perron-Frobenius operators
• A Neural Network for the Identical Kuramoto Equation: Architectural Considerations and Performance Evaluation
• Multi-patch isogeometric neural solver for partial differential equations on computer-aided design domains
• Spatio-Temporal Uncertainty-Modulated Physics-Informed Neural Networks for Solving Hyperbolic Conservation Laws with Strong Shocks
• Deep Domain Decomposition Method for Solving the Variational Inequality Problems
• Learning To Estimate Regions Of Attraction Of Autonomous Dynamical Systems Using Physics-Informed Neural Networks