Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Series

Abstract

A simple and interpretable way to learn a dynamical system from data is to interpolate its vector-field with a kernel. In particular, this strategy is highly efficient (both in terms of accuracy and complexity) when the kernel is data-adapted using Kernel Flows (KF)\cite{Owhadi19} (which uses gradient-based optimization to learn a kernel based on the premise that a kernel is good if there is no significant loss in accuracy if half of the data is used for interpolation). Despite its previous successes, this strategy (based on interpolating the vector field driving the dynamical system) breaks down when the observed time series is not regularly sampled in time. In this work, we propose to address this problem by directly approximating the vector field of the dynamical system by incorporating time differences between observations in the (KF) data-adapted kernels. We compare our approach with the classical one over different benchmark dynamical systems and show that it significantly improves the forecasting accuracy while remaining simple, fast, and robust.

Kernel Methods, Kernel Flows, Irregularly-Sampled Time Series

References in corpus (12)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
• Data-driven approximation of the Koopman generator: Model reduction, system identification, and control
• Kernel Flows: from learning kernels from data into the abyss
• Learning dynamical systems from data: a simple cross-validation perspective
• Operator-theoretic framework for forecasting nonlinear time series with kernel analog techniques
• Kernel-based approximation of the Koopman generator and Schrödinger operator
• Machine Learning for Prediction with Missing Dynamics
• Kernel methods for center manifold approximation and a data-based version of the Center Manifold Theorem
• One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernels
• Learning "best" kernels from data in Gaussian process regression. With application to aerodynamics
• A Note on Kernel Methods for Multiscale Systems with Critical Transitions

Cited by in corpus (2)

• Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots
• Analysis of Structured Deep Kernel Networks