Stability selection enables robust learning of partial differential equations from limited noisy data

Abstract

We present a statistical learning framework for robust identification of partial differential equations from noisy spatiotemporal data. Extending previous sparse regression approaches for inferring PDE models from simulated data, we address key issues that have thus far limited the application of these methods to noisy experimental data, namely their robustness against noise and the need for manual parameter tuning. We address both points by proposing a stability-based model selection scheme to determine the level of regularization required for reproducible recovery of the underlying PDE. This avoids manual parameter tuning and provides a principled way to improve the method's robustness against noise in the data. Our stability selection approach, termed PDE-STRIDE, can be combined with any sparsity-promoting penalized regression model and provides an interpretable criterion for model component importance. We show that in particular the combination of stability selection with the iterative hard-thresholding algorithm from compressed sensing provides a fast, parameter-free, and robust computational framework for PDE inference that outperforms previous algorithmic approaches with respect to recovery accuracy, amount of data required, and robustness to noise. We illustrate the performance of our approach on a wide range of noise-corrupted simulated benchmark problems, including 1D Burgers, 2D vorticity-transport, and 3D reaction-diffusion problems. We demonstrate the practical applicability of our method on real-world data by considering a purely data-driven re-evaluation of the advective triggering hypothesis for an embryonic polarization system in C.~elegans. Using fluorescence microscopy images of C.~elegans zygotes as input data, our framework is able to recover the PDE model for the regulatory reaction-diffusion-flow network of the associated proteins.

20 pages, 10 figures and supplementary material included

References in corpus (9)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Nearly unbiased variable selection under minimax concave penalty
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Machine Learning of Linear Differential Equations using Gaussian Processes
• PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network
• PDE-Net: Learning PDEs from Data
• Bayesian design of synthetic biological systems
• OpenFPM: A scalable open framework for particle and particle-mesh codes on parallel computers
• The identification of continuous, spatiotemporal systems

Cited by in corpus (11)

• Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
• PySINDy: A comprehensive Python package for robust sparse system identification
• DeepMoD: Deep learning for Model Discovery in noisy data
• Learning elliptic partial differential equations with randomized linear algebra
• Learning physically consistent mathematical models from data using group sparsity
• Image Inversion and Uncertainty Quantification for Constitutive Laws of Pattern Formation
• Sparsely constrained neural networks for model discovery of PDEs
• STENCIL-NET: Data-driven solution-adaptive discretization of partial differential equations
• Model discovery in the sparse sampling regime
• Sparsistent Model Discovery
• Discovering PDEs from Multiple Experiments