PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
arXiv:1812.04426 · doi:10.1016/j.jcp.2019.108925
Abstract
Partial differential equations (PDEs) are commonly derived based on empirical observations. However, recent advances of technology enable us to collect and store massive amount of data, which offers new opportunities for data-driven discovery of PDEs. In this paper, we propose a new deep neural network, called PDE-Net 2.0, to discover (time-dependent) PDEs from observed dynamic data with minor prior knowledge on the underlying mechanism that drives the dynamics. The design of PDE-Net 2.0 is based on our earlier work \cite{Long2018PDE} where the original version of PDE-Net was proposed. PDE-Net 2.0 is a combination of numerical approximation of differential operators by convolutions and a symbolic multi-layer neural network for model recovery. Comparing with existing approaches, PDE-Net 2.0 has the most flexibility and expressive power by learning both differential operators and the nonlinear response function of the underlying PDE model. Numerical experiments show that the PDE-Net 2.0 has the potential to uncover the hidden PDE of the observed dynamics, and predict the dynamical behavior for a relatively long time, even in a noisy environment.
arXiv comment16 pages, 15 figures. arXiv admin note: substantial text overlap with arXiv:1710.09668
References in corpus (16)
- Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
- Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
- Turbulence Modeling in the Age of Data
- Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
- Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
- Neural Ordinary Differential Equations
- Stable Architectures for Deep Neural Networks
- Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
- Data Driven Governing Equations Approximation Using Deep Neural Networks
- Provable approximation properties for deep neural networks
- PDE-Net: Learning PDEs from Data
- Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations
- Identification of physical processes via combined data-driven and data-assimilation methods
- Exponential Convergence of the Deep Neural Network Approximation for Analytic Functions
- Model Reduction with Memory and the Machine Learning of Dynamical Systems
- Extracting structured dynamical systems using sparse optimization with very few samples
Cited by in corpus (130)
- PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
- Weak SINDy For Partial Differential Equations
- Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
- A Physics-Guided Neural Network Framework for Elastic Plates: Comparison of Governing Equations-Based and Energy-Based Approaches
- DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks
- Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery
- A Review on Deep Learning in Medical Image Reconstruction
- Super-resolution and denoising of fluid flow using physics-informed convolutional neural networks without high-resolution labels
- Data-Driven Deep Learning of Partial Differential Equations in Modal Space
- Deep Learning in Deterministic Computational Mechanics
- Physics-informed PointNet: A deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
- PFNN: A Penalty-Free Neural Network Method for Solving a Class of Second-Order Boundary-Value Problems on Complex Geometries
- DeepMoD: Deep learning for Model Discovery in noisy data
- Hybrid FEM-NN models: Combining artificial neural networks with the finite element method
- MgNet: A Unified Framework of Multigrid and Convolutional Neural Network
- DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm
- A physics-informed operator regression framework for extracting data-driven continuum models
- Assessment of unsteady flow predictions using hybrid deep learning based reduced order models
- Data-driven recovery of hidden physics in reduced order modeling of fluid flows
- Learning to Optimize: A Primer and A Benchmark
- Uniformly Accurate Machine Learning Based Hydrodynamic Models for Kinetic Equations
- An overview on deep learning-based approximation methods for partial differential equations
- Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)
- 2022 Review of Data-Driven Plasma Science
- Theory and implementation of inelastic Constitutive Artificial Neural Networks
- Deep learning prediction of patient response time course from early data via neural-pharmacokinetic/pharmacodynamic modeling
- Continuous-time system identification with neural networks: Model structures and fitting criteria
- Solving inverse-PDE problems with physics-aware neural networks
- Feature engineering and symbolic regression methods for detecting hidden physics from sparse sensors
- Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics
- On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton--Jacobi partial differential equations
- Deep-learning of Parametric Partial Differential Equations from Sparse and Noisy Data
- On generalized residue network for deep learning of unknown dynamical systems
- DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimization
- Using Deep Learning to Extend the Range of Air-Pollution Monitoring and Forecasting
- Embedding Hard Physical Constraints in Neural Network Coarse-Graining of 3D Turbulence
- Deep learning neural networks for the third-order nonlinear Schrodinger equation: Solitons, breathers, and rogue waves
- Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
- Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data
- Extracting Interpretable Physical Parameters from Spatiotemporal Systems using Unsupervised Learning
- A Framework Based on Symbolic Regression Coupled with eXtended Physics-Informed Neural Networks for Gray-Box Learning of Equations of Motion from Data
- Differentiable Molecular Simulations for Control and Learning
- Short-term traffic prediction using physics-aware neural networks
- Physics-driven Learning of the Steady Navier-Stokes Equations using Deep Convolutional Neural Networks
- Sparse Identification of Truncation Errors
- PARC: Physics-Aware Recurrent Convolutional Neural Networks to Assimilate Meso-scale Reactive Mechanics of Energetic Materials
- FiniteNet: A Fully Convolutional LSTM Network Architecture for Time-Dependent Partial Differential Equations
- Extended Dynamic Mode Decomposition for Inhomogeneous Problems
- Physics-informed GANs for Coastal Flood Visualization
- A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks
- Accelerating Physics-Informed Neural Network Training with Prior Dictionaries
- Physics-integrated hybrid framework for model form error identification in nonlinear dynamical systems
- Physics-informed generative neural network: an application to troposphere temperature prediction
- NeuPDE: Neural Network Based Ordinary and Partial Differential Equations for Modeling Time-Dependent Data
- Image Inversion and Uncertainty Quantification for Constitutive Laws of Pattern Formation
- Data-driven Identification of 2D Partial Differential Equations using extracted physical features
- Data-driven, multi-moment fluid modeling of Landau damping
- Data-driven modeling of Landau damping by physics-informed neural networks
- Deep Ritz Method with Adaptive Quadrature for Linear Elasticity
- Neural network architectures using min-plus algebra for solving certain high dimensional optimal control problems and Hamilton-Jacobi PDEs
- Parsimony-Enhanced Sparse Bayesian Learning for Robust Discovery of Partial Differential Equations
- PDE-NetGen 1.0: from symbolic PDE representations of physical processes to trainable neural network representations
- Hypersolvers: Toward Fast Continuous-Depth Models
- PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equations
- Stability selection enables robust learning of partial differential equations from limited noisy data
- Deep Euler method: solving ODEs by approximating the local truncation error of the Euler method
- Learning Thermodynamically Stable and Galilean Invariant Partial Differential Equations for Non-equilibrium Flows
- Physics-informed Convolutional Neural Networks for Temperature Field Prediction of Heat Source Layout without Labeled Data
- Predicting Rigid Body Dynamics using Dual Quaternion Recurrent Neural Networks with Quaternion Attention
- Data-driven Discovery of Partial Differential Equations for Multiple-Physics Electromagnetic Problem
- Structure Preservation for the Deep Neural Network Multigrid Solver
- Learning Generalized Quasi-Geostrophic Models Using Deep Neural Numerical Models
- Discovery of Dynamics Using Linear Multistep Methods
- Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling
- Computational model discovery with reinforcement learning
- A Spectral Approach for Learning Spatiotemporal Neural Differential Equations
- Influence of initial conditions on data-driven model identification and information entropy for ideal mhd problems
- Physics-informed Deep Learning to Solve Three-dimensional Terzaghi Consolidation Equation: Forward and Inverse Problems
- A Data Driven Method for Computing Quasipotentials
- Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures
- Learning Differential Operators for Interpretable Time Series Modeling
- Automated differential equation solver based on the parametric approximation optimization
- Weak Collocation Regression method: fast reveal hidden stochastic dynamics from high-dimensional aggregate data
- Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modeling
- Machine Learning of Partial Differential Equations from Noise Data
- Neural Ordinary Differential Equations for Data-Driven Reduced Order Modeling of Environmental Hydrodynamics
- Data-Driven Constitutive Relation Reveals Scaling Law for Hydrodynamic Transport Coefficients
- Learning to Discretize: Solving 1D Scalar Conservation Laws via Deep Reinforcement Learning
- Meta-Auto-Decoder: A Meta-Learning Based Reduced Order Model for Solving Parametric Partial Differential Equations
- Frame-independent vector-cloud neural network for nonlocal constitutive modeling on arbitrary grids
- Data-driven learning of non-autonomous systems
- A Neural Solver for Variational Problems on CAD Geometries with Application to Electric Machine Simulation
- The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation
- Physics-Guided Discovery of Highly Nonlinear Parametric Partial Differential Equations
- DynaBench: A benchmark dataset for learning dynamical systems from low-resolution data
- RODE-Net: Learning Ordinary Differential Equations with Randomness from Data
- Adaptive parameters identification for nonlinear dynamics using deep permutation invariant networks
- Learning of discrete models of variational PDEs from data
- Translating Diffusion, Wavelets, and Regularisation into Residual Networks
- A Deep Learning Approach for Predicting Spatiotemporal Dynamics From Sparsely Observed Data
- Robust discovery of partial differential equations in complex situations
- Latent assimilation with implicit neural representations for unknown dynamics
- Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos
- Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data
- Physics-informed AI and ML-based sparse system identification algorithm for discovery of PDE's representing nonlinear dynamic systems
- CTSR: Cartesian tensor-based sparse regression for data-driven discovery of high-dimensional invariant governing equations
- Learnable-Differentiable Finite Volume Solver for Accelerated Simulation of Flows
- Partial Differential Equations is All You Need for Generating Neural Architectures -- A Theory for Physical Artificial Intelligence Systems
- STENCIL-NET: Data-driven solution-adaptive discretization of partial differential equations
- TIME: A Transparent, Interpretable, Model-Adaptive and Explainable Neural Network for Dynamic Physical Processes
- Data-Driven Theory-guided Learning of Partial Differential Equations using SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE)
- Symbolically Solving Partial Differential Equations using Deep Learning
- CONFIDE: Contextual Finite Differences Modelling of PDEs
- Machine learning and serving of discrete field theories -- when artificial intelligence meets the discrete universe
- Deep learning of parameterized equations with applications to uncertainty quantification
- A Natural Deep Ritz Method for Essential Boundary Value Problems
- Deep Domain Decomposition Method: Elliptic Problems
- Physics-informed Spline Learning for Nonlinear Dynamics Discovery
- Methods to Recover Unknown Processes in Partial Differential Equations Using Data
- Multiscale and Nonlocal Learning for PDEs using Densely Connected RNNs
- Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systems
- Hyperparameter Optimization in the Estimation of PDE and Delay-PDE models from data
- Enhancing Human-Machine Teaming for Medical Prognosis Through Neural Ordinary Differential Equations (NODEs)
- An artificial neural network approximation for Cauchy inverse problems
- Deep Domain Decomposition Method for Solving the Variational Inequality Problems
- The Machine Learning Approach to Moment Closure Relations for Plasma: A Review
- UniSymNet: A Unified Symbolic Network Guided by Transformer
- Taylor saves for later: disentanglement for video prediction using Taylor representation
- Jets and differential linear logic
- SlotPi: Physics-informed Object-centric Reasoning Models