Enhancing Biomedical Knowledge Discovery for Diseases: An Open-Source Framework Applied on Rett Syndrome and Alzheimer's Disease

Abstract

The ever-growing volume of biomedical publications creates a critical need for efficient knowledge discovery. In this context, we introduce an open-source end-to-end framework designed to construct knowledge around specific diseases directly from raw text. To facilitate research in disease-related knowledge discovery, we create two annotated datasets focused on Rett syndrome and Alzheimer's disease, enabling the identification of semantic relations between biomedical entities. Extensive benchmarking explores various ways to represent relations and entity representations, offering insights into optimal modeling strategies for semantic relation detection and highlighting language models' competence in knowledge discovery. We also conduct probing experiments using different layer representations and attention scores to explore transformers' ability to capture semantic relations.

Published in IEEE Access, doi: 10.1109/ACCESS.2024.3509714

References in corpus (5)

• BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
• Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health
• BioRED: A Rich Biomedical Relation Extraction Dataset
• Mining On Alzheimer's Diseases Related Knowledge Graph to Identity Potential AD-related Semantic Triples for Drug Repurposing
• An Information Extraction Study: Take In Mind the Tokenization!