Automatic Evaluation of Neural Personality-based Chatbots

Abstract

Stylistic variation is critical to render the utterances generated by conversational agents natural and engaging. In this paper, we focus on sequence-to-sequence models for open-domain dialogue response generation and propose a new method to evaluate the extent to which such models are able to generate responses that reflect different personality traits.

arXiv commentTo appear in the Proceedings of the 11th International Conference on Natural Language Generation (INLG-2018)

References in corpus (6)

• Sequence to Sequence Learning with Neural Networks
• How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation
• Attention with Intention for a Neural Network Conversation Model
• Generative Deep Neural Networks for Dialogue: A Short Review
• Multi-Task Learning for Speaker-Role Adaptation in Neural Conversation Models
• Data Distillation for Controlling Specificity in Dialogue Generation