Closed-form Inference and Prediction in Gaussian Process State-Space Models

Abstract

We examine an analytic variational inference scheme for the Gaussian Process State Space Model (GPSSM) - a probabilistic model for system identification and time-series modelling. Our approach performs variational inference over both the system states and the transition function. We exploit Markov structure in the true posterior, as well as an inducing point approximation to achieve linear time complexity in the length of the time series. Contrary to previous approaches, no Monte Carlo sampling is required: inference is cast as a deterministic optimisation problem. In a number of experiments, we demonstrate the ability to model non-linear dynamics in the presence of both process and observation noise as well as to impute missing information (e.g. velocities from raw positions through time), to de-noise, and to estimate the underlying dimensionality of the system. Finally, we also introduce a closed-form method for multi-step prediction, and a novel criterion for assessing the quality of our approximate posterior.

arXiv comment7 pages, 6 figures

References in corpus (1)

• Variational Gaussian Process State-Space Models

Cited by in corpus (4)

• FedLoc: Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing
• Non-Factorised Variational Inference in Dynamical Systems
• Bayesian Hidden Physics Models: Uncertainty Quantification for Discovery of Nonlinear Partial Differential Operators from Data
• Learning While Navigating: A Practical System Based on Variational Gaussian Process State-Space Model and Smartphone Sensory Data