Learning Symbolic Rules for Interpretable Deep Reinforcement Learning
arXiv:2103.08228
Abstract
Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To address this challenge and improve the transparency, we propose a Neural Symbolic Reinforcement Learning framework by introducing symbolic logic into DRL. This framework features a fertilization of reasoning and learning modules, enabling end-to-end learning with prior symbolic knowledge. Moreover, interpretability is achieved by extracting the logical rules learned by the reasoning module in a symbolic rule space. The experimental results show that our framework has better interpretability, along with competing performance in comparison to state-of-the-art approaches.
References in corpus (9)
- Prioritized Experience Replay
- High-Dimensional Continuous Control Using Generalized Advantage Estimation
- Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
- Visualizing and Understanding Atari Agents
- Relational Deep Reinforcement Learning
- Interestingness Elements for Explainable Reinforcement Learning: Understanding Agents' Capabilities and Limitations
- Graying the black box: Understanding DQNs
- Explain Your Move: Understanding Agent Actions Using Specific and Relevant Feature Attribution
- Incorporating Relational Background Knowledge into Reinforcement Learning via Differentiable Inductive Logic Programming