Predictive Control Using Learned State Space Models via Rolling Horizon Evolution
arXiv:2106.13911
Abstract
A large part of the interest in model-based reinforcement learning derives from the potential utility to acquire a forward model capable of strategic long term decision making. Assuming that an agent succeeds in learning a useful predictive model, it still requires a mechanism to harness it to generate and select among competing simulated plans. In this paper, we explore this theme combining evolutionary algorithmic planning techniques with models learned via deep learning and variational inference. We demonstrate the approach with an agent that reliably performs online planning in a set of visual navigation tasks.
arXiv commentAccepted at the Bridging the Gap Between AI Planning and Reinforcement Learning (PRL) Workshop at ICAPS 2021
References in corpus (7)
- Model-Based Reinforcement Learning for Atari
- Learning Latent Dynamics for Planning from Pixels
- Stochastic Latent Actor-Critic: Deep Reinforcement Learning with a Latent Variable Model
- Learning and Querying Fast Generative Models for Reinforcement Learning
- Efficient Evolutionary Methods for Game Agent Optimisation: Model-Based is Best
- Learning to Predict Without Looking Ahead: World Models Without Forward Prediction
- PlaNet of the Bayesians: Reconsidering and Improving Deep Planning Network by Incorporating Bayesian Inference