Combine PPO with NES to Improve Exploration
arXiv:1905.09492
Abstract
We introduce two approaches for combining neural evolution strategy (NES) and proximal policy optimization (PPO): parameter transfer and parameter space noise. Parameter transfer is a PPO agent with parameters transferred from a NES agent. Parameter space noise is to directly add noise to the PPO agent`s parameters. We demonstrate that PPO could benefit from both methods through experimental comparison on discrete action environments as well as continuous control tasks
18 pages, 14 figures
References in corpus (8)
- Continuous control with deep reinforcement learning
- Playing Atari with Deep Reinforcement Learning
- How transferable are features in deep neural networks?
- Evolution Strategies as a Scalable Alternative to Reinforcement Learning
- Unity: A General Platform for Intelligent Agents
- Parameter Space Noise for Exploration
- Count-Based Exploration with Neural Density Models
- #Exploration: A Study of Count-Based Exploration for Deep Reinforcement Learning