Syntax-based Deep Matching of Short Texts

Abstract

Many tasks in natural language processing, ranging from machine translation to question answering, can be reduced to the problem of matching two sentences or more generally two short texts. We propose a new approach to the problem, called Deep Match Tree (DeepMatch${}_{tree}$), under a general setting. The approach consists of two components, 1) a mining algorithm to discover patterns for matching two short-texts, defined in the product space of dependency trees, and 2) a deep neural network for matching short texts using the mined patterns, as well as a learning algorithm to build the network having a sparse structure. We test our algorithm on the problem of matching a tweet and a response in social media, a hard matching problem proposed in [Wang et al., 2013], and show that DeepMatch${}_{tree}$ can outperform a number of competitor models including one without using dependency trees and one based on word-embedding, all with large margins

Accepted by IJCAI-2015 as full paper

References in corpus (1)

• Convolutional Neural Network Architectures for Matching Natural Language Sentences

Cited by in corpus (11)

• A Deep Relevance Matching Model for Ad-hoc Retrieval
• A Survey on Dialogue Systems: Recent Advances and New Frontiers
• Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
• Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems
• A Sequential Matching Framework for Multi-turn Response Selection in Retrieval-based Chatbots
• Learning Matching Models with Weak Supervision for Response Selection in Retrieval-based Chatbots
• Improving Retrieval Modeling Using Cross Convolution Networks And Multi Frequency Word Embedding
• The World is Not Binary: Learning to Rank with Grayscale Data for Dialogue Response Selection
• Building an Efficient and Effective Retrieval-based Dialogue System via Mutual Learning
• Addressee and Response Selection for Multilingual Conversation
• Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection