Deep Learning of Koopman Representation for Control
arXiv:2010.07546
Abstract
We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN is employed for the data-driven identification of basis function used in the linear lifting of nonlinear control system dynamics. The controller synthesis is purely data-driven and does not rely on a priori domain knowledge. The OpenAI Gym environment, employed for Reinforcement Learning-based control design, is used for data generation and learning of Koopman operator in control setting. The method is applied to two classic dynamical systems on OpenAI Gym environment to demonstrate the capability.
arXiv comment6 pages, 8 figures
References in corpus (7)
- Adam: A Method for Stochastic Optimization
- Continuous control with deep reinforcement learning
- Deep learning for universal linear embeddings of nonlinear dynamics
- Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control
- Koopman operator-based model reduction for switched-system control of PDEs
- A Kernel-Based Approach to Data-Driven Koopman Spectral Analysis
- Learning Models for Shared Control of Human-Machine Systems with Unknown Dynamics