Explicit State Tracking with Semi-Supervision for Neural Dialogue Generation

Abstract

The task of dialogue generation aims to automatically provide responses given previous utterances. Tracking dialogue states is an important ingredient in dialogue generation for estimating users' intention. However, the \emph{expensive nature of state labeling} and the \emph{weak interpretability} make the dialogue state tracking a challenging problem for both task-oriented and non-task-oriented dialogue generation: For generating responses in task-oriented dialogues, state tracking is usually learned from manually annotated corpora, where the human annotation is expensive for training; for generating responses in non-task-oriented dialogues, most of existing work neglects the explicit state tracking due to the unlimited number of dialogue states. In this paper, we propose the \emph{semi-supervised explicit dialogue state tracker} (SEDST) for neural dialogue generation. To this end, our approach has two core ingredients: \emph{CopyFlowNet} and \emph{posterior regularization}. Specifically, we propose an encoder-decoder architecture, named \emph{CopyFlowNet}, to represent an explicit dialogue state with a probabilistic distribution over the vocabulary space. To optimize the training procedure, we apply a posterior regularization strategy to integrate indirect supervision. Extensive experiments conducted on both task-oriented and non-task-oriented dialogue corpora demonstrate the effectiveness of our proposed model. Moreover, we find that our proposed semi-supervised dialogue state tracker achieves a comparable performance as state-of-the-art supervised learning baselines in state tracking procedure.

References in corpus (4)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• A Neural Conversational Model
• Neural Responding Machine for Short-Text Conversation
• Latent Variable Dialogue Models and their Diversity

Cited by in corpus (19)

• Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences
• Advances and Challenges in Conversational Recommender Systems: A Survey
• Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems
• Interactive Path Reasoning on Graph for Conversational Recommendation
• Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering
• Seamlessly Unifying Attributes and Items: Conversational Recommendation for Cold-Start Users
• Semi-Supervised Variational Reasoning for Medical Dialogue Generation
• Meta-evaluation of Conversational Search Evaluation Metrics
• Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems
• Towards Standard Criteria for human evaluation of Chatbots: A Survey
• TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance
• A Probabilistic End-To-End Task-Oriented Dialog Model with Latent Belief States towards Semi-Supervised Learning
• Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems
• Question-Aware Memory Network for Multi-hop Question Answering in Human-Robot Interaction
• AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generation
• Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation System
• Improving Limited Labeled Dialogue State Tracking with Self-Supervision
• GECOR: An End-to-End Generative Ellipsis and Co-reference Resolution Model for Task-Oriented Dialogue
• ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling