Data-driven Identification of 2D Partial Differential Equations using extracted physical features

Abstract

Many scientific phenomena are modeled by Partial Differential Equations (PDEs). The development of data gathering tools along with the advances in machine learning (ML) techniques have raised opportunities for data-driven identification of governing equations from experimentally observed data. We propose an ML method to discover the terms involved in the equation from two-dimensional spatiotemporal data. Robust and useful physical features are extracted from data samples to represent the specific behaviors imposed by each mathematical term in the equation. Compared to the previous models, this idea provides us with the ability to discover 2D equations with time derivatives of different orders, and also to identify new underlying physics on which the model has not been trained. Moreover, the model can work with small sets of low-resolution data while avoiding numerical differentiations. The results indicate robustness of the features extracted based on prior knowledge in comparison to automatically detected features by a Three-dimensional Convolutional Neural Network (3D CNN) given the same amounts of data. Although particular PDEs are studied in this work, the idea of the proposed approach could be extended for reliable identification of various PDEs.

References in corpus (25)

• Scikit-learn: Machine Learning in Python
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Explaining and Harnessing Adversarial Examples
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• DeepXDE: A deep learning library for solving differential equations
• DGM: A deep learning algorithm for solving partial differential equations
• Solving high-dimensional partial differential equations using deep learning
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
• Machine Learning of Linear Differential Equations using Gaussian Processes
• PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
• Hamiltonian Neural Networks
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• Adversarial Examples Are Not Bugs, They Are Features
• Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
• Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledge
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Data-driven discovery of PDEs in complex datasets
• Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
• Deep Learning the Physics of Transport Phenomena
• Learning dominant physical processes with data-driven balance models
• Propagation Speed of the Maximum of the Fundamental Solution to the Fractional Diffusion-Wave Equation
• Physics-informed deep generative models
• Identification of physical processes via combined data-driven and data-assimilation methods
• Weakly-Supervised Deep Learning of Heat Transport via Physics Informed Loss

Cited by in corpus (4)

• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• Learning physics-constrained subgrid-scale closures in the small-data regime for stable and accurate LES
• Parsimony-Enhanced Sparse Bayesian Learning for Robust Discovery of Partial Differential Equations
• Robust physics discovery via supervised and unsupervised pattern recognition using the Euler characteristic