To Test Machine Comprehension, Start by Defining Comprehension

Jesse Dunietz, Gregory Burnham, Akash Bharadwaj +3

Many tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering wh…