9 papers
Artemis: Anatomy-Resolved inTervention for Eliminating Multimodal NeuroImage confounderS
Siyuan Dai, Yang Du, Kun Zhao +6
Multimodal neuroimaging, integrating functional connectivity from fMRI and structural connectivity from DTI, enables non-invasive analysis of brain networks using graph neural netw…
Seizure-Semiology-Suite (S3): A Clinically Multimodal Dataset, Benchmark, and Models for Seizure Semiology Understanding
Lina Zhang, Tonmoy Monsoor, Peizheng Li +23
While Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in general video understanding, their capacity to interpret involuntary, and spatio-temporal…
OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis
Jing Hao, Siyuan Dai, Yongxin Zhang +13
Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for s…
Deep Models, Shallow Alignment: Uncovering the Granularity Mismatch in Neural Decoding
Yang Du, Siyuan Dai, Yonghao Song +3
Neural visual decoding is a central problem in brain-computer interface research, aiming to reconstruct human visual perception and to elucidate the structure of neural representat…
HERO: Hierarchical Evidential Reasoning Optimization for Radiology Report Generation via Reason-then-Summarize
Kun Zhao, Siyuan Dai, Guodong Liu +6
Multimodal Large Language Models (MLLMs) have substantially advanced Radiology Report Generation (RRG), yet aligning them through reinforcement learning (RL) remains challenging du…
R-GenIMA: Integrating Neuroimaging and Genetics with Interpretable Multimodal AI for Alzheimer's Disease Progression
Kun Zhao, Siyuan Dai, Yingying Zhang +9
Early detection of Alzheimer's disease (AD) requires models capable of integrating macro-scale neuroanatomical alterations with micro-scale genetic susceptibility, yet existing mul…