Extending Neural Generative Conversational Model using External Knowledge Sources
arXiv:1809.05524
Abstract
The use of connectionist approaches in conversational agents has been progressing rapidly due to the availability of large corpora. However current generative dialogue models often lack coherence and are content poor. This work proposes an architecture to incorporate unstructured knowledge sources to enhance the next utterance prediction in chit-chat type of generative dialogue models. We focus on Sequence-to-Sequence (Seq2Seq) conversational agents trained with the Reddit News dataset, and consider incorporating external knowledge from Wikipedia summaries as well as from the NELL knowledge base. Our experiments show faster training time and improved perplexity when leveraging external knowledge.
arXiv commentAccepted in EMNLP 2018
References in corpus (7)
- Sequence to Sequence Learning with Neural Networks
- A Neural Conversational Model
- On the Properties of Neural Machine Translation: Encoder-Decoder Approaches
- Adversarial Learning for Neural Dialogue Generation
- A Survey of Available Corpora for Building Data-Driven Dialogue Systems
- Generating Sentences by Editing Prototypes
- Augmenting End-to-End Dialog Systems with Commonsense Knowledge