Planning in Dynamic Environments with Conditional Autoregressive Models
arXiv:1811.10097
Abstract
We demonstrate the use of conditional autoregressive generative models (van den Oord et al., 2016a) over a discrete latent space (van den Oord et al., 2017b) for forward planning with MCTS. In order to test this method, we introduce a new environment featuring varying difficulty levels, along with moving goals and obstacles. The combination of high-quality frame generation and classical planning approaches nearly matches true environment performance for our task, demonstrating the usefulness of this method for model-based planning in dynamic environments.
6 pages, 1 figure, in Proceedings of the Prediction and Generative Modeling in Reinforcement Learning Workshop at the International Conference on Machine Learning (ICML) in 2018
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- WaveNet: A Generative Model for Raw Audio
- Conditional Image Generation with PixelCNN Decoders
- Action-Conditional Video Prediction using Deep Networks in Atari Games
- The Predictron: End-To-End Learning and Planning
- Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play
- Learning model-based planning from scratch
- Learning and Querying Fast Generative Models for Reinforcement Learning
- Learning to Search with MCTSnets
- Video Pixel Networks
- Fast Generation for Convolutional Autoregressive Models