Black-Box Inference for Non-Linear Latent Force Models
arXiv:1906.09199
Abstract
Latent force models are systems whereby there is a mechanistic model describing the dynamics of the system state, with some unknown forcing term that is approximated with a Gaussian process. If such dynamics are non-linear, it can be difficult to estimate the posterior state and forcing term jointly, particularly when there are system parameters that also need estimating. This paper uses black-box variational inference to jointly estimate the posterior, designing a multivariate extension to local inverse autoregressive flows as a flexible approximater of the system. We compare estimates on systems where the posterior is known, demonstrating the effectiveness of the approximation, and apply to problems with non-linear dynamics, multi-output systems and models with non-Gaussian likelihoods.
arXiv comment13 pages plus references and supplementary
References in corpus (13)
- Adam: A Method for Stochastic Optimization
- WaveNet: A Generative Model for Raw Audio
- Conditional Image Generation with PixelCNN Decoders
- Variational Inference with Normalizing Flows
- Density estimation using Real NVP
- MADE: Masked Autoencoder for Distribution Estimation
- Autoregressive Convolutional Neural Networks for Asynchronous Time Series
- Learning unknown ODE models with Gaussian processes
- State-Space Inference for Non-Linear Latent Force Models with Application to Satellite Orbit Prediction
- Banded Matrix Operators for Gaussian Markov Models in the Automatic Differentiation Era
- State Space Gaussian Processes with Non-Gaussian Likelihood
- Black-Box Autoregressive Density Estimation for State-Space Models
- AReS and MaRS - Adversarial and MMD-Minimizing Regression for SDEs