Modeling Latent Non-Linear Dynamical System over Time Series

Abstract

We study the problem of modeling a non-linear dynamical system when given a time series by deriving equations directly from the data. Despite the fact that time series data are given as input, models for dynamics and estimation algorithms that incorporate long-term temporal dependencies are largely absent from existing studies. In this paper, we introduce a latent state to allow time-dependent modeling and formulate this problem as a dynamics estimation problem in latent states. We face multiple technical challenges, including (1) modeling latent non-linear dynamics and (2) solving circular dependencies caused by the presence of latent states. To tackle these challenging problems, we propose a new method, Latent Non-Linear equation modeling (LaNoLem), that can model a latent non-linear dynamical system and a novel alternating minimization algorithm for effectively estimating latent states and model parameters. In addition, we introduce criteria to control model complexity without human intervention. Compared with the state-of-the-art model, LaNoLem achieves competitive performance for estimating dynamics while outperforming other methods in prediction.

Accepted by AAAI'25

References in corpus (10)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Deep learning for time series classification: a review
• Efficient Learning of Generalized Linear and Single Index Models with Isotonic Regression
• Learning nonlinear dynamical systems from a single trajectory
• Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems
• Transformer-based Planning for Symbolic Regression
• Learning concise representations for regression by evolving networks of trees
• Promoting global stability in data-driven models of quadratic nonlinear dynamics
• Chaos as an interpretable benchmark for forecasting and data-driven modelling
• Learning Sparse Nonlinear Dynamics via Mixed-Integer Optimization