Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems
arXiv:2509.22845 · doi:10.1145/3340531.3411967
Abstract
Recently, knowledge-grounded conversations in the open domain gain great attention from researchers. Existing works on retrieval-based dialogue systems have paid tremendous efforts to utilize neural networks to build a matching model, where all of the context and knowledge contents are used to match the response candidate with various representation methods. Actually, different parts of the context and knowledge are differentially important for recognizing the proper response candidate, as many utterances are useless due to the topic shift. Those excessive useless information in the context and knowledge can influence the matching process and leads to inferior performance. To address this problem, we propose a multi-turn \textbf{R}esponse \textbf{S}election \textbf{M}odel that can \textbf{D}etect the relevant parts of the \textbf{C}ontext and \textbf{K}nowledge collection (\textbf{RSM-DCK}). Our model first uses the recent context as a query to pre-select relevant parts of the context and knowledge collection at the word-level and utterance-level semantics. Further, the response candidate interacts with the selected context and knowledge collection respectively. In the end, The fused representation of the context and response candidate is utilized to post-select the relevant parts of the knowledge collection more confidently for matching. We test our proposed model on two benchmark datasets. Evaluation results indicate that our model achieves better performance than the existing methods, and can effectively detect the relevant context and knowledge for response selection.
10 pages, 4 figures, accepted by CIKM 2020
References in corpus (6)
- Convolutional Neural Network Architectures for Matching Natural Language Sentences
- Wizard of Wikipedia: Knowledge-Powered Conversational agents
- Neural Natural Language Inference Models Enhanced with External Knowledge
- Neural Responding Machine for Short-Text Conversation
- Low-Resource Knowledge-Grounded Dialogue Generation
- Learning to Select Knowledge for Response Generation in Dialog Systems
Cited by in corpus (8)
- Semi-Supervised Variational Reasoning for Medical Dialogue Generation
- Learning Implicit User Profiles for Personalized Retrieval-Based Chatbot
- Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goals
- OpenViDial: A Large-Scale, Open-Domain Dialogue Dataset with Visual Contexts
- OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contexts
- Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension
- Detecting Speaker Personas from Conversational Texts
- Pchatbot: A Large-Scale Dataset for Personalized Chatbot