Interpretable Model-based Hierarchical Reinforcement Learning using Inductive Logic Programming
arXiv:2106.11417
Abstract
Recently deep reinforcement learning has achieved tremendous success in wide ranges of applications. However, it notoriously lacks data-efficiency and interpretability. Data-efficiency is important as interacting with the environment is expensive. Further, interpretability can increase the transparency of the black-box-style deep RL models and hence gain trust from the users. In this work, we propose a new hierarchical framework via symbolic RL, leveraging a symbolic transition model to improve the data-efficiency and introduce the interpretability for learned policy. This framework consists of a high-level agent, a subtask solver and a symbolic transition model. Without assuming any prior knowledge on the state transition, we adopt inductive logic programming (ILP) to learn the rules of symbolic state transitions, introducing interpretability and making the learned behavior understandable to users. In empirical experiments, we confirmed that the proposed framework offers approximately between 30\% to 40\% more data efficiency over previous methods.
References in corpus (10)
- Towards A Rigorous Science of Interpretable Machine Learning
- A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
- Explainable Machine Learning for Scientific Insights and Discoveries
- Solving Rubik's Cube with a Robot Hand
- Benchmarking Batch Deep Reinforcement Learning Algorithms
- Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis
- Learning Dexterous Manipulation Policies from Experience and Imitation
- PEORL: Integrating Symbolic Planning and Hierarchical Reinforcement Learning for Robust Decision-Making
- Learning Algorithms via Neural Logic Networks
- Hierarchical Reinforcement Learning with Abductive Planning