Knowledge Guided Named Entity Recognition for BioMedical Text
arXiv:1911.03869
Abstract
In this work, we formulate the NER task as a multi-answer knowledge guided QA task (KGQA) which helps to predict entities only by assigning B, I and O tags without associating entity types with the tags. We provide different knowledge contexts, such as, entity types, questions, definitions and examples along with the text and train on a combined dataset of 18 biomedical corpora. This formulation (a) enables systems to jointly learn NER specific features from varied NER datasets, (b) can use knowledge-text attention to identify words having higher similarity to provided knowledge, improving performance, (c) reduces system confusion by reducing the prediction classes to B, I, O only, and (d) makes detection of nested entities easier. We perform extensive experiments of this KGQA formulation on 18 biomedical NER datasets, and through experiments we note that knowledge helps in achieving better performance. Our problem formulation is able to achieve state-of-the-art results in 12 datasets.
6 pages, 2 figures, 5 tables, WIP
References in corpus (9)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- BioBERT: a pre-trained biomedical language representation model for biomedical text mining
- A Survey on Recent Advances in Named Entity Recognition from Deep Learning models
- Enhancing Clinical Concept Extraction with Contextual Embeddings
- The Natural Language Decathlon: Multitask Learning as Question Answering
- A Unified MRC Framework for Named Entity Recognition
- SciBERT: A Pretrained Language Model for Scientific Text
- How Additional Knowledge can Improve Natural Language Commonsense Question Answering?
- Question Answering is a Format; When is it Useful?