An Attention-Based Word-Level Interaction Model: Relation Detection for Knowledge Base Question Answering

Abstract

Relation detection plays a crucial role in Knowledge Base Question Answering (KBQA) because of the high variance of relation expression in the question. Traditional deep learning methods follow an encoding-comparing paradigm, where the question and the candidate relation are represented as vectors to compare their semantic similarity. Max- or average- pooling operation, which compresses the sequence of words into fixed-dimensional vectors, becomes the bottleneck of information. In this paper, we propose to learn attention-based word-level interactions between questions and relations to alleviate the bottleneck issue. Similar to the traditional models, the question and relation are firstly represented as sequences of vectors. Then, instead of merging the sequence into a single vector with pooling operation, soft alignments between words from the question and the relation are learned. The aligned words are subsequently compared with the convolutional neural network (CNN) and the comparison results are merged finally. Through performing the comparison on low-level representations, the attention-based word-level interaction model (ABWIM) relieves the information loss issue caused by merging the sequence into a fixed-dimensional vector before the comparison. The experimental results of relation detection on both SimpleQuestions and WebQuestions datasets show that ABWIM achieves state-of-the-art accuracy, demonstrating its effectiveness.

Paper submitted to Neurocomputing at 11.12.2017

References in corpus (9)

• ADADELTA: An Adaptive Learning Rate Method
• Language Modeling with Gated Convolutional Networks
• Reasoning about Entailment with Neural Attention
• Large-scale Simple Question Answering with Memory Networks
• Machine Comprehension Using Match-LSTM and Answer Pointer
• LSTM-based Deep Learning Models for Non-factoid Answer Selection
• Multi-Perspective Context Matching for Machine Comprehension
• Character-Level Question Answering with Attention
• Open Question Answering with Weakly Supervised Embedding Models

Cited by in corpus (3)

• UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answering
• Interactive Question Answering Systems: Literature Review
• A Complex KBQA System using Multiple Reasoning Paths