6 papers
Brain-IT-VQA: From Brain Signals to Answers
Roman Beliy, Matias Cosarinsky, Oliver Heinimann +2
Decoding visual content from fMRI signals recorded while a person views images, and specifically answering questions about the seen images, is a long-standing challenge. While sign…
The Wisdom of a Crowd of Brains: A Universal Brain Encoder
Roman Beliy, Navve Wasserman, Amit Zalcher +1
Image-to-fMRI encoding is important for both neuroscience research and practical applications. However, such "Brain-Encoders" have been typically trained per-subject and per fMRI-d…
From Activation to Specificity: Automating Counterfactual Testing of Visual Representations in the Human Brain
Yuval Golbari, Navve Wasserman, Matias Cosarinsky +5
Identifying which brain regions represent a visual concept in the human brain is a central challenge in neuroscience. Existing approaches have localized coarse functional regions (…
Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformer
Roman Beliy, Amit Zalcher, Jonathan Kogman +2
Reconstructing images seen by people from their fMRI brain recordings provides a non-invasive window into the human brain. Despite recent progress enabled by diffusion models, curr…
Don't Judge Before You CLIP: A Unified Approach for Perceptual Tasks
Amit Zalcher, Navve Wasserman, Roman Beliy +2
Visual perceptual tasks aim to predict human judgment of images (e.g., emotions invoked by images, image quality assessment). Unlike objective tasks such as object/scene recognitio…
Functional Brain-to-Brain Transformation with No Shared Data
Navve Wasserman, Roman Beliy, Roy Urbach +1
Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is i…