A Survey on Recent Advances and Challenges in Reinforcement Learning Methods for Task-Oriented Dialogue Policy Learning
arXiv:2202.13675 · doi:10.1007/s11633-022-1347-y
Abstract
Dialogue Policy Learning is a key component in a task-oriented dialogue system (TDS) that decides the next action of the system given the dialogue state at each turn. Reinforcement Learning (RL) is commonly chosen to learn the dialogue policy, regarding the user as the environment and the system as the agent. Many benchmark datasets and algorithms have been created to facilitate the development and evaluation of dialogue policy based on RL. In this paper, we survey recent advances and challenges in dialogue policy from the prescriptive of RL. More specifically, we identify the major problems and summarize corresponding solutions for RL-based dialogue policy learning. Besides, we provide a comprehensive survey of applying RL to dialogue policy learning by categorizing recent methods into basic elements in RL. We believe this survey can shed a light on future research in dialogue management.
References in corpus (11)
- A Survey on Dialogue Systems: Recent Advances and New Frontiers
- Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System
- Why We Need New Evaluation Metrics for NLG
- An Application of Reinforcement Learning to Dialogue Strategy Selection in a Spoken Dialogue System for Email
- A Laplacian Framework for Option Discovery in Reinforcement Learning
- Modelling Hierarchical Structure between Dialogue Policy and Natural Language Generator with Option Framework for Task-oriented Dialogue System
- A Survey on Dialog Management: Recent Advances and Challenges
- Speaker Role Contextual Modeling for Language Understanding and Dialogue Policy Learning
- Cross-domain Dialogue Policy Transfer via Simultaneous Speech-act and Slot Alignment
- AutoEG: Automated Experience Grafting for Off-Policy Deep Reinforcement Learning
- Integrating Pretrained Language Model for Dialogue Policy Learning