Fully differentiable model discovery

Abstract

Model discovery aims at autonomously discovering differential equations underlying a dataset. Approaches based on Physics Informed Neural Networks (PINNs) have shown great promise, but a fully-differentiable model which explicitly learns the equation has remained elusive. In this paper we propose such an approach by integrating neural network-based surrogates with Sparse Bayesian Learning (SBL). This combination yields a robust model discovery algorithm, which we showcase on various datasets. We then identify a connection with multitask learning, and build on it to construct a Physics Informed Normalizing Flow (PINF). We present a proof-of-concept using a PINF to directly learn a density model from single particle data. Our work expands PINNs to various types of neural network architectures, and connects neural network-based surrogates to the rich field of Bayesian parameter inference.

References in corpus (10)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Variational Inference with Normalizing Flows
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• Multi-Task Learning as Multi-Objective Optimization
• Data-driven discovery of PDEs in complex datasets
• DeepMoD: Deep learning for Model Discovery in noisy data
• On spike-and-slab priors for Bayesian equation discovery of nonlinear dynamical systems via sparse linear regression
• Learning physically consistent mathematical models from data using group sparsity
• Machine Discovery of Partial Differential Equations from Spatiotemporal Data
• Sparsely constrained neural networks for model discovery of PDEs