Who did What: A Large-Scale Person-Centered Cloze Dataset

Abstract

We have constructed a new "Who-did-What" dataset of over 200,000 fill-in-the-gap (cloze) multiple choice reading comprehension problems constructed from the LDC English Gigaword newswire corpus. The WDW dataset has a variety of novel features. First, in contrast with the CNN and Daily Mail datasets (Hermann et al., 2015) we avoid using article summaries for question formation. Instead, each problem is formed from two independent articles --- an article given as the passage to be read and a separate article on the same events used to form the question. Second, we avoid anonymization --- each choice is a person named entity. Third, the problems have been filtered to remove a fraction that are easily solved by simple baselines, while remaining 84% solvable by humans. We report performance benchmarks of standard systems and propose the WDW dataset as a challenge task for the community.

arXiv commentTo appear at EMNLP 2016. Our dataset is available at tticnlp.github.io/who_did_what

Cited by in corpus (17)

• SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine
• RACE: Large-scale ReAding Comprehension Dataset From Examinations
• MEMEN: Multi-layer Embedding with Memory Networks for Machine Comprehension
• Embracing data abundance: BookTest Dataset for Reading Comprehension
• Linguistic Knowledge as Memory for Recurrent Neural Networks
• Learning Cross-Context Entity Representations from Text
• Hierarchical Question Answering for Long Documents
• Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension
• Broad Context Language Modeling as Reading Comprehension
• Neural Skill Transfer from Supervised Language Tasks to Reading Comprehension
• Large-scale Cloze Test Dataset Created by Teachers
• Knowledge Based Machine Reading Comprehension
• GenNet : Reading Comprehension with Multiple Choice Questions using Generation and Selection model
• Dependent Gated Reading for Cloze-Style Question Answering
• Question-Aware Sentence Gating Networks for Question and Answering
• SCDE: Sentence Cloze Dataset with High Quality Distractors From Examinations
• A Coarse to Fine Question Answering System based on Reinforcement Learning