Learnings Options End-to-End for Continuous Action Tasks
arXiv:1712.00004
Abstract
We present new results on learning temporally extended actions for continuoustasks, using the options framework (Suttonet al.[1999b], Precup [2000]). In orderto achieve this goal we work with the option-critic architecture (Baconet al.[2017])using a deliberation cost and train it with proximal policy optimization (Schulmanet al.[2017]) instead of vanilla policy gradient. Results on Mujoco domains arepromising, but lead to interesting questions aboutwhena given option should beused, an issue directly connected to the use of initiation sets.
Cited by in corpus (14)
- Learning Abstract Options
- Learning Event-triggered Control from Data through Joint Optimization
- Motion Planning by Reinforcement Learning for an Unmanned Aerial Vehicle in Virtual Open Space with Static Obstacles
- Indoor Path Planning for an Unmanned Aerial Vehicle via Curriculum Learning
- Diversity-Enriched Option-Critic
- Efficient Deep Reinforcement Learning via Adaptive Policy Transfer
- Interpretable Reinforcement Learning Inspired by Piaget's Theory of Cognitive Development
- Learning to Locomote with Deep Neural-Network and CPG-based Control in a Soft Snake Robot
- Indoor Path Planning for Multiple Unmanned Aerial Vehicles via Curriculum Learning
- ACE: An Actor Ensemble Algorithm for Continuous Control with Tree Search
- oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actions
- Options of Interest: Temporal Abstraction with Interest Functions
- DynoPlan: Combining Motion Planning and Deep Neural Network based Controllers for Safe HRL
- Leveraging Sequentiality in Reinforcement Learning from a Single Demonstration