An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering
arXiv:1912.02145
Abstract
To produce a domain-agnostic question answering model for the Machine Reading Question Answering (MRQA) 2019 Shared Task, we investigate the relative benefits of large pre-trained language models, various data sampling strategies, as well as query and context paraphrases generated by back-translation. We find a simple negative sampling technique to be particularly effective, even though it is typically used for datasets that include unanswerable questions, such as SQuAD 2.0. When applied in conjunction with per-domain sampling, our XLNet (Yang et al., 2019)-based submission achieved the second best Exact Match and F1 in the MRQA leaderboard competition.
arXiv commentAccepted at the 2nd Workshop on Machine Reading for Question Answering
References in corpus (5)
- QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
- SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine
- Learning and Evaluating General Linguistic Intelligence
- RACE: Large-scale ReAding Comprehension Dataset From Examinations
- A BERT Baseline for the Natural Questions