4 papers
Multigranular Evaluation for Brain Visual Decoding
Weihao Xia, Cengiz Oztireli
Existing evaluation protocols for brain visual decoding predominantly rely on coarse metrics that obscure inter-model differences, lack neuroscientific foundation, and fail to capt…
Exploring The Visual Feature Space for Multimodal Neural Decoding
Weihao Xia, Cengiz Oztireli
The intrication of brain signals drives research that leverages multimodal AI to align brain modalities with visual and textual data for explainable descriptions. However, most exi…
UMBRAE: Unified Multimodal Brain Decoding
Weihao Xia, Raoul de Charette, Cengiz Öztireli +1
We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-s…
DREAM: Visual Decoding from Reversing Human Visual System
Weihao Xia, Raoul de Charette, Cengiz Öztireli +1
In this work we present DREAM, an fMRI-to-image method for reconstructing viewed images from brain activities, grounded on fundamental knowledge of the human visual system. We craf…