Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty

Abstract

In this paper, we propose a probabilistic physics-guided framework, termed Physics-guided Deep Markov Model (PgDMM). The framework targets the inference of the characteristics and latent structure of nonlinear dynamical systems from measurement data, where exact inference of latent variables is typically intractable. A recently surfaced option pertains to leveraging variational inference to perform approximate inference. In such a scheme, transition and emission functions of the system are parameterized via feed-forward neural networks (deep generative models). However, due to the generalized and highly versatile formulation of neural network functions, the learned latent space often lacks physical interpretation and structured representation. To address this, we bridge physics-based state space models with Deep Markov Models, thus delivering a hybrid modeling framework for unsupervised learning and identification of nonlinear dynamical systems. The proposed framework takes advantage of the expressive power of deep learning, while retaining the driving physics of the dynamical system by imposing physics-driven restrictions on the side of the latent space. We demonstrate the benefits of such a fusion in terms of achieving improved performance on illustrative simulation examples and experimental case studies of nonlinear systems. Our results indicate that the physics-based models involved in the employed transition and emission functions essentially enforce a more structured and physically interpretable latent space, which is essential for enhancing and generalizing the predictive capabilities of deep learning-based models.

Accepted for publication in Mechanical Systems and Signal Processing

References in corpus (5)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Learning Stochastic Recurrent Networks
• A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
• Knowledge Transfer between Buildings for Seismic Damage Diagnosis through Adversarial Learning

Cited by in corpus (6)

• Neural Extended Kalman Filters for Learning and Predicting Dynamics of Structural Systems
• Neural modal ordinary differential equations: Integrating physics-based modeling with neural ordinary differential equations for modeling high-dimensional monitored structures
• Physics-integrated hybrid framework for model form error identification in nonlinear dynamical systems
• Monitoring-Supported Value Generation for Managing Structures and Infrastructure Systems
• Grammar-based Ordinary Differential Equation Discovery
• Navigating Uncertainties in Machine Learning for Structural Dynamics: A Comprehensive Survey of Probabilistic and Non-Probabilistic Approaches in Forward and Inverse Problems