5 citations · 24 across the 34 of their papers we have counts for
3 papers · 1 filter
Can Question Generation Debias Question Answering Models? A Case Study on Question-Context Lexical Overlap
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
Question answering (QA) models for reading comprehension have been demonstrated to exploit unintended dataset biases such as question-context lexical overlap. This hinders QA model…
Embracing Ambiguity: Shifting the Training Target of NLI Models
Johannes Mario Meissner, Napat Thumwanit, Saku Sugawara +1
Natural Language Inference (NLI) datasets contain examples with highly ambiguous labels. While many research works do not pay much attention to this fact, several recent efforts ha…
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
Nikita Nangia, Saku Sugawara, Harsh Trivedi +3
Crowdsourcing is widely used to create data for common natural language understanding tasks. Despite the importance of these datasets for measuring and refining model understanding…