Sequential Sentence Matching Network for Multi-turn Response Selection in Retrieval-based Chatbots

Abstract

Recently, open domain multi-turn chatbots have attracted much interest from lots of researchers in both academia and industry. The dominant retrieval-based methods use context-response matching mechanisms for multi-turn response selection. Specifically, the state-of-the-art methods perform the context-response matching by word or segment similarity. However, these models lack a full exploitation of the sentence-level semantic information, and make simple mistakes that humans can easily avoid. In this work, we propose a matching network, called sequential sentence matching network (S2M), to use the sentence-level semantic information to address the problem. Firstly and most importantly, we find that by using the sentence-level semantic information, the network successfully addresses the problem and gets a significant improvement on matching, resulting in a state-of-the-art performance. Furthermore, we integrate the sentence matching we introduced here and the usual word similarity matching reported in the current literature, to match at different semantic levels. Experiments on three public data sets show that such integration further improves the model performance.

arXiv comment10 pages, 4 figures

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• Distributed Representations of Words and Phrases and their Compositionality
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• TensorFlow: A system for large-scale machine learning
• LSTM-based Deep Learning Models for Non-factoid Answer Selection
• Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
• Improved Deep Learning Baselines for Ubuntu Corpus Dialogs
• Natural Language Inference by Tree-Based Convolution and Heuristic Matching
• Sequential Attention-based Network for Noetic End-to-End Response Selection