11 papers
Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning
Kaitao Chen, Weiqian Zhao, Jiamin Wu +6
Vision-language models (VLMs) combining reinforcement learning (RL) ignite remarkable progress in multimodal reasoning, yet still struggle with medical images, which typically exhi…
Project Imaging-X: A Survey of 1000+ Open-Access Medical Imaging Datasets for Foundation Model Development
Zhongying Deng, Cheng Tang, Ziyan Huang +124
Foundation models have demonstrated remarkable success across diverse domains and tasks, primarily due to the thrive of large-scale, diverse, and high-quality datasets. However, in…
PRISM: A Framework Harnessing Unsupervised Visual Representations and Textual Prompts for Explainable MACE Survival Prediction from Cardiac Cine MRI
Haoyang Su, Jin-Yi Xiang, Shaohao Rui +6
Accurate prediction of major adverse cardiac events (MACE) remains a central challenge in cardiovascular prognosis. We present PRISM (Prompt-guided Representation Integration for S…
InvCoSS: Inversion-driven Continual Self-supervised Learning in Medical Multi-modal Image Pre-training
Zihao Luo, Shaohao Rui, Zhenyu Tang +2
Continual self-supervised learning (CSSL) in medical imaging trains a foundation model sequentially, alleviating the need for collecting multi-modal images for joint training and o…
Think Twice to See More: Iterative Visual Reasoning in Medical VLMs
Kaitao Chen, Shaohao Rui, Yankai Jiang +6
Medical vision-language models (VLMs) excel at image-text understanding but typically rely on a single-pass reasoning that neglects localized visual cues. In clinical practice, how…
Mediator-Guided Multi-Agent Collaboration among Open-Source Models for Medical Decision-Making
Kaitao Chen, Mianxin Liu, Daoming Zong +5
Complex medical decision-making involves cooperative workflows operated by different clinicians. Designing AI multi-agent systems can expedite and augment human-level clinical deci…