Reading Comprehension using Entity-based Memory Network

Abstract

This paper introduces a novel neural network model for question answering, the \emph{entity-based memory network}. It enhances neural networks' ability of representing and calculating information over a long period by keeping records of entities contained in text. The core component is a memory pool which comprises entities' states. These entities' states are continuously updated according to the input text. Questions with regard to the input text are used to search the memory pool for related entities and answers are further predicted based on the states of retrieved entities. Compared with previous memory network models, the proposed model is capable of handling fine-grained information and more sophisticated relations based on entities. We formulated several different tasks as question answering problems and tested the proposed model. Experiments reported satisfying results.

References in corpus (8)

• Sequence to Sequence Learning with Neural Networks
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Distributed Representations of Sentences and Documents
• Teaching Machines to Read and Comprehend
• Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
• Large-scale Simple Question Answering with Memory Networks
• Transition-Based Dependency Parsing with Stack Long Short-Term Memory
• Semi-supervised Convolutional Neural Networks for Text Categorization via Region Embedding