CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question Answering
arXiv:2010.16021
Abstract
Clinical question answering (QA) aims to automatically answer questions from medical professionals based on clinical texts. Studies show that neural QA models trained on one corpus may not generalize well to new clinical texts from a different institute or a different patient group, where large-scale QA pairs are not readily available for model retraining. To address this challenge, we propose a simple yet effective framework, CliniQG4QA, which leverages question generation (QG) to synthesize QA pairs on new clinical contexts and boosts QA models without requiring manual annotations. In order to generate diverse types of questions that are essential for training QA models, we further introduce a seq2seq-based question phrase prediction (QPP) module that can be used together with most existing QG models to diversify the generation. Our comprehensive experiment results show that the QA corpus generated by our framework can improve QA models on the new contexts (up to 8% absolute gain in terms of Exact Match), and that the QPP module plays a crucial role in achieving the gain.
arXiv commentIEEE BIBM 2021 Best Paper; The first two authors contributed equally
References in corpus (5)
- Bidirectional Attention Flow for Machine Comprehension
- Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
- A scikit-based Python environment for performing multi-label classification
- Towards Domain Adaptation from Limited Data for Question Answering Using Deep Neural Networks
- Annotating Electronic Medical Records for Question Answering