BioConceptVec: creating and evaluating literature-based biomedical concept embeddings on a large scale

Abstract

Capturing the semantics of related biological concepts, such as genes and mutations, is of significant importance to many research tasks in computational biology such as protein-protein interaction detection, gene-drug association prediction, and biomedical literature-based discovery. Here, we propose to leverage state-of-the-art text mining tools and machine learning models to learn the semantics via vector representations (aka. embeddings) of over 400,000 biological concepts mentioned in the entire PubMed abstracts. Our learned embeddings, namely BioConceptVec, can capture related concepts based on their surrounding contextual information in the literature, which is beyond exact term match or co-occurrence-based methods. BioConceptVec has been thoroughly evaluated in multiple bioinformatics tasks consisting of over 25 million instances from nine different biological datasets. The evaluation results demonstrate that BioConceptVec has better performance than existing methods in all tasks. Finally, BioConceptVec is made freely available to the research community and general public via https://github.com/ncbi-nlp/BioConceptVec.

33 pages, 6 figures, 7 tables, accepted by PLOS Computational Biology

References in corpus (8)

• Distributed Representations of Words and Phrases and their Compositionality
• RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism
• Onto2Vec: joint vector-based representation of biological entities and their ontology-based annotations
• BioSentVec: creating sentence embeddings for biomedical texts
• A Comparison of Word Embeddings for the Biomedical Natural Language Processing
• Relation extraction between the clinical entities based on the shortest dependency path based LSTM
• Retrofitting Concept Vector Representations of Medical Concepts to Improve Estimates of Semantic Similarity and Relatedness
• Concept-Based Embeddings for Natural Language Processing

Cited by in corpus (4)

• Benchmarking large language models for biomedical natural language processing applications and recommendations
• Bioformer: an efficient transformer language model for biomedical text mining
• Predicting drug-gene relations via analogy tasks with word embeddings
• A reproducible experimental survey on biomedical sentence similarity: a string-based method sets the state of the art