8 papers
UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretation
Linshan Wu, Yuxiang Nie, Sunan He +12
The integration of AI-assisted biomedical image analysis into clinical practice demands AI-generated findings that are not only accurate but also interpretable to clinicians. Howev…
A Chain of Diagnosis Framework for Accurate and Explainable Radiology Report Generation
Haibo Jin, Haoxuan Che, Sunan He +1
Despite the progress of radiology report generation (RRG), existing works face two challenges: 1) The performances in clinical efficacy are unsatisfactory, especially for lesion at…
Large-scale Self-supervised Video Foundation Model for Intelligent Surgery
Shu Yang, Fengtao Zhou, Leon Mayer +16
Computer-Assisted Intervention (CAI) has the potential to revolutionize modern surgery, with surgical scene understanding serving as a critical component in supporting decision-mak…
MedBookVQA: A Systematic and Comprehensive Medical Benchmark Derived from Open-Access Book
Sau Lai Yip, Sunan He, Yuxiang Nie +4
The accelerating development of general medical artificial intelligence (GMAI), powered by multimodal large language models (MLLMs), offers transformative potential for addressing…
EvdCLIP: Improving Vision-Language Retrieval with Entity Visual Descriptions from Large Language Models
GuangHao Meng, Sunan He, Jinpeng Wang +7
Vision-language retrieval (VLR) has attracted significant attention in both academia and industry, which involves using text (or images) as queries to retrieve corresponding images…
An Explainable Biomedical Foundation Model via Large-Scale Concept-Enhanced Vision-Language Pre-training
Yuxiang Nie, Sunan He, Yequan Bie +14
The clinical adoption of artificial intelligence (AI) in medical imaging requires models that are both diagnostically accurate and interpretable to clinicians. While current multim…