Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models
arXiv:1910.01274
Abstract
Entity recognition is a critical first step to a number of clinical NLP applications, such as entity linking and relation extraction. We present the first attempt to apply state-of-the-art entity recognition approaches on a newly released dataset, MedMentions. This dataset contains over 4000 biomedical abstracts, annotated for UMLS semantic types. In comparison to existing datasets, MedMentions contains a far greater number of entity types, and thus represents a more challenging but realistic scenario in a real-world setting. We explore a number of relevant dimensions, including the use of contextual versus non-contextual word embeddings, general versus domain-specific unsupervised pre-training, and different deep learning architectures. We contrast our results against the well-known i2b2 2010 entity recognition dataset, and propose a new method to combine general and domain-specific information. While producing a state-of-the-art result for the i2b2 2010 task (F1 = 0.90), our results on MedMentions are significantly lower (F1 = 0.63), suggesting there is still plenty of opportunity for improvement on this new data.
arXiv comment11 pages, accepted at LOUHI2019 workshop
References in corpus (8)
- Distributed Representations of Words and Phrases and their Compositionality
- BioBERT: a pre-trained biomedical language representation model for biomedical text mining
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Enhancing Clinical Concept Extraction with Contextual Embeddings
- Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition
- Clinical Concept Extraction with Contextual Word Embedding
- Joint Entity Extraction and Assertion Detection for Clinical Text
- Bidirectional LSTM-CRF for Clinical Concept Extraction