Meta-Learning for Koopman Spectral Analysis with Short Time-series

Abstract

Koopman spectral analysis has attracted attention for nonlinear dynamical systems since we can analyze nonlinear dynamics with a linear regime by embedding data into a Koopman space by a nonlinear function. For the analysis, we need to find appropriate embedding functions. Although several neural network-based methods have been proposed for learning embedding functions, existing methods require long time-series for training neural networks. This limitation prohibits performing Koopman spectral analysis in applications where only short time-series are available. In this paper, we propose a meta-learning method for estimating embedding functions from unseen short time-series by exploiting knowledge learned from related but different time-series. With the proposed method, a representation of a given short time-series is obtained by a bidirectional LSTM for extracting its properties. The embedding function of the short time-series is modeled by a neural network that depends on the time-series representation. By sharing the LSTM and neural networks across multiple time-series, we can learn common knowledge from different time-series while modeling time-series-specific embedding functions with the time-series representation. Our model is trained such that the expected test prediction error is minimized with the episodic training framework. We experimentally demonstrate that the proposed method achieves better performance in terms of eigenvalue estimation and future prediction than existing methods.

References in corpus (12)

• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Deep learning for universal linear embeddings of nonlinear dynamics
• Matching Networks for One Shot Learning
• N-BEATS: Neural basis expansion analysis for interpretable time series forecasting
• Deep Dynamical Modeling and Control of Unsteady Fluid Flows
• Efficient inference of parsimonious phenomenological models of cellular dynamics using S-systems and alternating regression
• Attentive Neural Processes
• Recurrent Attentive Neural Process for Sequential Data
• Zero-shot Domain Adaptation without Domain Semantic Descriptors
• Recurrent Neural Processes
• Few-shot Learning for Time-series Forecasting