64 citations · 375 across the 45 of their papers we have counts for
9 papers · 1 filter
SituatedQA: Incorporating Extra-Linguistic Contexts into QA
Michael J. Q. Zhang, Eunsol Choi
Answers to the same question may change depending on the extra-linguistic contexts (when and where the question was asked). To study this challenge, we introduce SituatedQA, an ope…
Learning with Different Amounts of Annotation: From Zero to Many Labels
Shujian Zhang, Chengyue Gong, Eunsol Choi
Training NLP systems typically assumes access to annotated data that has a single human label per example. Given imperfect labeling from annotators and inherent ambiguity of langua…
CREAK: A Dataset for Commonsense Reasoning over Entity Knowledge
Yasumasa Onoe, Michael J. Q. Zhang, Eunsol Choi +1
Most benchmark datasets targeting commonsense reasoning focus on everyday scenarios: physical knowledge like knowing that you could fill a cup under a waterfall [Talmor et al., 201…
Knowing More About Questions Can Help: Improving Calibration in Question Answering
Shujian Zhang, Chengyue Gong, Eunsol Choi
We study calibration in question answering, estimating whether model correctly predicts answer for each question. Unlike prior work which mainly rely on the model's confidence scor…
Misinfo Reaction Frames: Reasoning about Readers' Reactions to News Headlines
Saadia Gabriel, Skyler Hallinan, Maarten Sap +4
Even to a simple and short news headline, readers react in a multitude of ways: cognitively (e.g. inferring the writer's intent), emotionally (e.g. feeling distrust), and behaviora…
Can NLI Models Verify QA Systems' Predictions?
Jifan Chen, Eunsol Choi, Greg Durrett
To build robust question answering systems, we need the ability to verify whether answers to questions are truly correct, not just "good enough" in the context of imperfect QA data…