BioSentVec: creating sentence embeddings for biomedical texts

Abstract

Sentence embeddings have become an essential part of today's natural language processing (NLP) systems, especially together advanced deep learning methods. Although pre-trained sentence encoders are available in the general domain, none exists for biomedical texts to date. In this work, we introduce BioSentVec: the first open set of sentence embeddings trained with over 30 million documents from both scholarly articles in PubMed and clinical notes in the MIMIC-III Clinical Database. We evaluate BioSentVec embeddings in two sentence pair similarity tasks in different text genres. Our benchmarking results demonstrate that the BioSentVec embeddings can better capture sentence semantics compared to the other competitive alternatives and achieve state-of-the-art performance in both tasks. We expect BioSentVec to facilitate the research and development in biomedical text mining and to complement the existing resources in biomedical word embeddings. BioSentVec is publicly available at https://github.com/ncbi-nlp/BioSentVec

arXiv comment5 pages, 3 tables and 2 figures accepted by The Seventh IEEE International Conference on Healthcare Informatics (ICHI 2019)

References in corpus (1)

• Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features

Cited by in corpus (5)

• Benchmarking large language models for biomedical natural language processing applications and recommendations
• BioConceptVec: creating and evaluating literature-based biomedical concept embeddings on a large scale
• Filter Drug-induced Liver Injury Literature with Natural Language Processing and Ensemble Learning
• The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Papers
• A reproducible experimental survey on biomedical sentence similarity: a string-based method sets the state of the art