activity
20222024
most citedMultimodal foundation models are better simulators of the human brain

11 citations · 16 across the 6 of their papers we have counts for

collaborators

6 papers

cs.HC2024

Identifying the Hierarchical Emotional Areas in the Human Brain Through Information Fusion

Zhongyu Huang, Changde Du, Chaozhuo Li +2

The brain basis of emotion has consistently received widespread attention, attracting a large number of studies to explore this cutting-edge topic. However, the methods employed in…

cs.CV20242 cited

CLIP-MUSED: CLIP-Guided Multi-Subject Visual Neural Information Semantic Decoding

Qiongyi Zhou, Changde Du, Shengpei Wang +1

The study of decoding visual neural information faces challenges in generalizing single-subject decoding models to multiple subjects, due to individual differences. Moreover, the l…

cs.CV2023

MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion

Yizhuo Lu, Changde Du, Qiongyi zhou +2

Reconstructing visual stimuli from brain recordings has been a meaningful and challenging task. Especially, the achievement of precise and controllable image reconstruction bears g…

cs.SD2023

Auditory Attention Decoding with Task-Related Multi-View Contrastive Learning

Xiaoyu Chen, Changde Du, Qiongyi Zhou +1

The human brain can easily focus on one speaker and suppress others in scenarios such as a cocktail party. Recently, researchers found that auditory attention can be decoded from t…

cs.CV20233 cited

MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion

Yizhuo Lu, Changde Du, Dianpeng Wang +1

Reconstructing visual stimuli from measured functional magnetic resonance imaging (fMRI) has been a meaningful and challenging task. Previous studies have successfully achieved rec…

cs.NE202211 cited

Multimodal foundation models are better simulators of the human brain

Haoyu Lu, Qiongyi Zhou, Nanyi Fei +8

Multimodal learning, especially large-scale multimodal pre-training, has developed rapidly over the past few years and led to the greatest advances in artificial intelligence (AI).…