96 citations · 131 across the 9 of their papers we have counts for
3 papers · 1 filter
IIRC: A Dataset of Incomplete Information Reading Comprehension Questions
James Ferguson, Matt Gardner, Hannaneh Hajishirzi +2
Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension (RC) tasks only focus on questions for which the conte…
Easy, Reproducible and Quality-Controlled Data Collection with Crowdaq
Qiang Ning, Hao Wu, Pradeep Dasigi +5
High-quality and large-scale data are key to success for AI systems. However, large-scale data annotation efforts are often confronted with a set of common challenges: (1) designin…
Evaluating Models' Local Decision Boundaries via Contrast Sets
Matt Gardner, Yoav Artzi, Victoria Basmova +23
Standard test sets for supervised learning evaluate in-distribution generalization. Unfortunately, when a dataset has systematic gaps (e.g., annotation artifacts), these evaluation…