Markov Chain Monte Carlo for Koopman-based Optimal Control: Technical Report
arXiv:2405.01788 · doi:10.1109/LCSYS.2024.3411930
Abstract
We propose a Markov Chain Monte Carlo (MCMC) algorithm based on Gibbs sampling with parallel tempering to solve nonlinear optimal control problems. The algorithm is applicable to nonlinear systems with dynamics that can be approximately represented by a finite dimensional Koopman model, potentially with high dimension. This algorithm exploits linearity of the Koopman representation to achieve significant computational saving for large lifted states. We use a video-game to illustrate the use of the method.
References in corpus (5)
- Parallel Tempering: Theory, Applications, and New Perspectives
- Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control
- Koopman invariant subspaces and finite linear representations of nonlinear dynamical systems for control
- Massively Parallel Probabilistic Computing with Sparse Ising Machines
- Markov Chain Monte Carlo for Koopman-based Optimal Control: Technical Report