Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

Abstract

Understanding real-world dynamical phenomena remains a challenging task. Across various scientific disciplines, machine learning has advanced as the go-to technology to analyze nonlinear dynamical systems, identify patterns in big data, and make decision around them. Neural networks are now consistently used as universal function approximators for data with underlying mechanisms that are incompletely understood or exceedingly complex. However, neural networks alone ignore the fundamental laws of physics and often fail to make plausible predictions. Here we integrate data, physics, and uncertainties by combining neural networks, physics-informed modeling, and Bayesian inference to improve the predictive potential of traditional neural network models. We embed the physical model of a damped harmonic oscillator into a fully-connected feed-forward neural network to explore a simple and illustrative model system, the outbreak dynamics of COVID-19. Our Physics-Informed Neural Networks can seamlessly integrate data and physics, robustly solve forward and inverse problems, and perform well for both interpolation and extrapolation, even for a small amount of noisy and incomplete data. At only minor additional cost, they can self-adaptively learn the weighting between data and physics. Combined with Bayesian Neural Networks, they can serve as priors in a Bayesian Inference, and provide credible intervals for uncertainty quantification. Our study reveals the inherent advantages and disadvantages of Neural Networks, Bayesian Inference, and a combination of both and provides valuable guidelines for model selection. While we have only demonstrated these approaches for the simple model problem of a seasonal endemic infectious disease, we anticipate that the underlying concepts and trends generalize to more complex disease conditions and, more broadly, to a wide variety of nonlinear dynamical systems.

References in corpus (6)

• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Integrating Machine Learning and Multiscale Modeling: Perspectives, Challenges, and Opportunities in the Biological, Biomedical, and Behavioral Sciences
• Multi-fidelity Bayesian Neural Networks: Algorithms and Applications
• Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism
• Fractional SEIR Model and Data-Driven Predictions of COVID-19 Dynamics of Omicron Variant
• Learning Functional Priors and Posteriors from Data and Physics

Cited by in corpus (18)

• A new family of Constitutive Artificial Neural Networks towards automated model discovery
• Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
• Physics-informed radial basis network (PIRBN): A local approximating neural network for solving nonlinear PDEs
• Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems
• A Physics-Informed Neural Network approach for compartmental epidemiological models
• Approaching epidemiological dynamics of COVID-19 with physics-informed neural networks
• A physics and data co-driven surrogate modeling method for high-dimensional rare event simulation
• A Generative Modeling Framework for Inferring Families of Biomechanical Constitutive Laws in Data-Sparse Regimes
• L-HYDRA: Multi-Head Physics-Informed Neural Networks
• Empowering Bayesian Neural Networks with Functional Priors through Anchored Ensembling for Mechanics Surrogate Modeling Applications
• Modeling Global Surface Dust Deposition Using Physics-Informed Neural Networks
• Forecasting and predicting stochastic agent-based model data with biologically-informed neural networks
• Auto-weighted Bayesian Physics-Informed Neural Networks and robust estimations for multitask inverse problems in pore-scale imaging of dissolution
• Indoor thermal comfort management: A Bayesian machine-learning approach to data denoising and dynamics prediction of HVAC systems
• Disentangling Aleatoric and Epistemic Uncertainty in Physics-Informed Neural Networks. Application to Insulation Material Degradation Prognostics
• Fast meta-solvers for 3D complex-shape scatterers using neural operators trained on a non-scattering problem
• Uncertainty quantification and stability of neural operators for prediction of three-dimensional turbulence
• Neural network methods for Neumann series problems of Perron-Frobenius operators