A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models

Abstract

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and knowledge of facts. One reason for this is the relative lack of labeled data from which personality consistency and fact usage could be learned together with dialogue behaviour. To address this, we introduce a new labeled dialogue dataset in the domain of movie discussions, where every dialogue is based on pre-specified facts and opinions. We thoroughly validate the collected dialogue for adherence of the participants to their given fact and opinion profile, and find that the general quality in this respect is high. This process also gives us an additional layer of annotation that is potentially useful for training models. We introduce as a baseline an end-to-end trained self-attention decoder model trained on this data and show that it is able to generate opinionated responses that are judged to be natural and knowledgeable and show attentiveness.

arXiv comment8 Pages, 8 Figures, 5 Tables. Accepted paper for LREC 2020 conference

References in corpus (9)

• Decoupled Weight Decay Regularization
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Wizard of Wikipedia: Knowledge-Powered Conversational agents
• How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation
• Deep Reinforcement Learning for Dialogue Generation
• TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents
• Personalizing Dialogue Agents: I have a dog, do you have pets too?
• A Dataset for Document Grounded Conversations
• Targetable Named Entity Recognition in Social Media