Deep Kernel Learning of Dynamical Models from High-Dimensional Noisy Data

Abstract

This work proposes a Stochastic Variational Deep Kernel Learning method for the data-driven discovery of low-dimensional dynamical models from high-dimensional noisy data. The framework is composed of an encoder that compresses high-dimensional measurements into low-dimensional state variables, and a latent dynamical model for the state variables that predicts the system evolution over time. The training of the proposed model is carried out in an unsupervised manner, i.e., not relying on labeled data. Our learning method is evaluated on the motion of a pendulum -- a well studied baseline for nonlinear model identification and control with continuous states and control inputs -- measured via high-dimensional noisy RGB images. Results show that the method can effectively denoise measurements, learn compact state representations and latent dynamical models, as well as identify and quantify modeling uncertainties.

References in corpus (7)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• A Brief Survey of Deep Reinforcement Learning
• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Data-driven discovery of coordinates and governing equations
• Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
• State Representation Learning for Control: An Overview
• Bayesian operator inference for data-driven reduced-order modeling