Interpretable Multi-Step Reasoning with Knowledge Extraction on Complex Healthcare Question Answering

Abstract

Healthcare question answering assistance aims to provide customer healthcare information, which widely appears in both Web and mobile Internet. The questions usually require the assistance to have proficient healthcare background knowledge as well as the reasoning ability on the knowledge. Recently a challenge involving complex healthcare reasoning, HeadQA dataset, has been proposed, which contains multiple-choice questions authorized for the public healthcare specialization exam. Unlike most other QA tasks that focus on linguistic understanding, HeadQA requires deeper reasoning involving not only knowledge extraction, but also complex reasoning with healthcare knowledge. These questions are the most challenging for current QA systems, and the current performance of the state-of-the-art method is slightly better than a random guess. In order to solve this challenging task, we present a Multi-step reasoning with Knowledge extraction framework (MurKe). The proposed framework first extracts the healthcare knowledge as supporting documents from the large corpus. In order to find the reasoning chain and choose the correct answer, MurKe iterates between selecting the supporting documents, reformulating the query representation using the supporting documents and getting entailment score for each choice using the entailment model. The reformulation module leverages selected documents for missing evidence, which maintains interpretability. Moreover, we are striving to make full use of off-the-shelf pre-trained models. With less trainable weight, the pre-trained model can easily adapt to healthcare tasks with limited training samples. From the experimental results and ablation study, our system is able to outperform several strong baselines on the HeadQA dataset.

10 pages, 6 figures

References in corpus (20)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Semi-Supervised Classification with Graph Convolutional Networks
• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
• Bidirectional Attention Flow for Machine Comprehension
• ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
• SQuAD: 100,000+ Questions for Machine Comprehension of Text
• Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
• ReasoNet: Learning to Stop Reading in Machine Comprehension
• Reading Wikipedia to Answer Open-Domain Questions
• Exploring Graph-structured Passage Representation for Multi-hop Reading Comprehension with Graph Neural Networks
• Multi-hop Question Answering via Reasoning Chains
• BAG: Bi-directional Attention Entity Graph Convolutional Network for Multi-hop Reasoning Question Answering
• Task-Oriented Query Reformulation with Reinforcement Learning
• Commonsense for Generative Multi-Hop Question Answering Tasks
• Answering Complex Open-domain Questions Through Iterative Query Generation
• Ranking Paragraphs for Improving Answer Recall in Open-Domain Question Answering
• HEAD-QA: A Healthcare Dataset for Complex Reasoning
• Training a Ranking Function for Open-Domain Question Answering
• NCRF++: An Open-source Neural Sequence Labeling Toolkit
• Self-Assembling Modular Networks for Interpretable Multi-Hop Reasoning

Cited by in corpus (5)

• On the Opportunities and Risks of Foundation Models
• Biomedical Question Answering: A Survey of Approaches and Challenges
• Dense Hierarchical Retrieval for Open-Domain Question Answering
• Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources
• Generating multiple-choice questions for medical question answering with distractors and cue-masking