Machine Comprehension Using Match-LSTM and Answer Pointer
arXiv:1608.07905
Abstract
Machine comprehension of text is an important problem in natural language processing. A recently released dataset, the Stanford Question Answering Dataset (SQuAD), offers a large number of real questions and their answers created by humans through crowdsourcing. SQuAD provides a challenging testbed for evaluating machine comprehension algorithms, partly because compared with previous datasets, in SQuAD the answers do not come from a small set of candidate answers and they have variable lengths. We propose an end-to-end neural architecture for the task. The architecture is based on match-LSTM, a model we proposed previously for textual entailment, and Pointer Net, a sequence-to-sequence model proposed by Vinyals et al.(2015) to constrain the output tokens to be from the input sequences. We propose two ways of using Pointer Net for our task. Our experiments show that both of our two models substantially outperform the best results obtained by Rajpurkar et al.(2016) using logistic regression and manually crafted features.
11 pages; 3 figures
References in corpus (1)
Cited by in corpus (20)
- Adversarial Examples for Evaluating Reading Comprehension Systems
- Learning Recurrent Span Representations for Extractive Question Answering
- Multi-Perspective Context Matching for Machine Comprehension
- R: Reinforced Reader-Ranker for Open-Domain Question Answering
- DCN+: Mixed Objective and Deep Residual Coattention for Question Answering
- A Joint Model for Question Answering and Question Generation
- NewsQA: A Machine Comprehension Dataset
- MEMEN: Multi-layer Embedding with Memory Networks for Machine Comprehension
- S-Net: From Answer Extraction to Answer Generation for Machine Reading Comprehension
- End-to-End Answer Chunk Extraction and Ranking for Reading Comprehension
- Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering
- A Comparative Study of Word Embeddings for Reading Comprehension
- Learning Loss Functions for Semi-supervised Learning via Discriminative Adversarial Networks
- MemexQA: Visual Memex Question Answering
- Phase Conductor on Multi-layered Attentions for Machine Comprehension
- Smarnet: Teaching Machines to Read and Comprehend Like Human
- An Attention-Based Word-Level Interaction Model: Relation Detection for Knowledge Base Question Answering
- Distributed Representation for Traditional Chinese Medicine Herb via Deep Learning Models
- Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension
- An Empirical Analysis of Multiple-Turn Reasoning Strategies in Reading Comprehension Tasks