6 papers
Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding
Linghao Meng, Qiankun Li, Junyuan Mao +7
While Multimodal Large Language Models (MLLMs) demonstrate superior generalization in fundamental video tasks, restricted context windows limit their long video understanding. To a…
Thinking in Scales: Accelerating Gigapixel Pathology Image Analysis via Adaptive Continuous Reasoning
Jiusong Ge, Yingkang Zhan, Wenjie Zhao +13
Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and…
Towards Clinically Interpretable Ophthalmic VQA via Spatially-Grounded Lesion Evidence
Xingyue Wang, Bo Liu, Meng Wang +4
Visual Question Answering (VQA) holds great promise for clinical support, particularly in ophthalmology, where retinal fundus photography is essential for diagnosis. However, ophth…
Enhancing Medical Visual Grounding via Knowledge-guided Spatial Prompts
Yifan Gao, Tao Zhou, Yi Zhou +3
Medical Visual Grounding (MVG) aims to identify diagnostically relevant phrases from free-text radiology reports and localize their corresponding regions in medical images, providi…
Deep Expert Injection for Anchoring Retinal VLMs with Domain-Specific Knowledge
Shuai Lu, Meng Wang, Jia Guo +6
Large Vision Language Models (LVLMs) show immense potential for automated ophthalmic diagnosis. However, their clinical deployment is severely hindered by lacking domain-specific k…
Colon-X: Advancing Intelligent Colonoscopy toward Clinical Reasoning
Ge-Peng Ji, Jingyi Liu, Deng-Ping Fan +2
In this study, we present Colon-X, an open initiative aimed at advancing multimodal intelligence in colonoscopy. We begin by constructing ColonVQA, the most comprehensive multimoda…