4 papers
Fusion is not one-size-fits-all: Cross-Modal Representation Alignment for Time-to-Event Modeling
Zhemin Zhang, Weijie Chen, David Le +7
Accurate time-to-event (TTE) prediction from multimodal clinical data remains challenging due to modality imbalance and distribution shift. We introduce a foundation model-driven f…
Position: Restructuring of Categories and Implementation of Guidelines Essential for VLM Adoption in Healthcare
Amara Tariq, Rimita Lahiri, Charles Kahn +1
The intricate and multifaceted nature of vision language model (VLM) development, adaptation, and application necessitates the establishment of clear and standardized reporting pro…
Opportunistic Screening for Pancreatic Cancer using Computed Tomography Imaging and Radiology Reports
David Le, Ramon Correa-Medero, Amara Tariq +3
Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive cancer, with most cases diagnosed at stage IV and a five-year overall survival rate below 5%. Early detection and pro…
Knowledge-grounded Adaptation Strategy for Vision-language Models: Building Unique Case-set for Screening Mammograms for Residents Training
Aisha Urooj Khan, John Garrett, Tyler Bradshaw +4
A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-t…