24 citations · 46 across the 11 of their papers we have counts for
5 papers · 1 filter
Task-conditioned probing of instruction-tuned multimodal LLMs: Region-specific brain alignment patterns under naturalistic stimuli
Subba Reddy Oota, Khushbu Pahwa, Prachi Jindal +5
Recent voxel-wise multimodal brain encoding studies have shown that multimodal large language models (MLLMs) exhibit a higher degree of brain alignment compared to unimodal models.…
Correlating instruction-tuning (in multimodal models) with vision-language processing (in the brain)
Subba Reddy Oota, Akshett Jindal, Ishani Mondal +6
Transformer-based language models, though not explicitly trained to mimic brain recordings, have demonstrated surprising alignment with brain activity. Progress in these models-thr…
Multi-modal brain encoding models for multi-modal stimuli
Subba Reddy Oota, Khushbu Pahwa, Mounika Marreddy +3
Despite participants engaging in unimodal stimuli, such as watching images or silent videos, recent work has demonstrated that multi-modal Transformer models can predict visual bra…
Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)
Subba Reddy Oota, Zijiao Chen, Manish Gupta +4
Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI b…
Cross-view Brain Decoding
Subba Reddy Oota, Jashn Arora, Manish Gupta +1
How the brain captures the meaning of linguistic stimuli across multiple views is still a critical open question in neuroscience. Consider three different views of the concept apar…