A Survey on Interactive Reinforcement Learning: Design Principles and Open Challenges

Abstract

Interactive reinforcement learning (RL) has been successfully used in various applications in different fields, which has also motivated HCI researchers to contribute in this area. In this paper, we survey interactive RL to empower human-computer interaction (HCI) researchers with the technical background in RL needed to design new interaction techniques and propose new applications. We elucidate the roles played by HCI researchers in interactive RL, identifying ideas and promising research directions. Furthermore, we propose generic design principles that will provide researchers with a guide to effectively implement interactive RL applications.

References in corpus (6)

• Episodic Exploration for Deep Deterministic Policies: An Application to StarCraft Micromanagement Tasks
• Machine Teaching: A New Paradigm for Building Machine Learning Systems
• Deep Reinforcement Learning from Policy-Dependent Human Feedback
• Agent-Agnostic Human-in-the-Loop Reinforcement Learning
• Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual Examples
• WHY: Natural Explanations from a Robot Navigator