11 papers
fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction
Jingyang Huo, Xiangru Huang, Chentao Shen +6
Reconstructing dynamic human faces from brain activity provides a powerful way to study how the mind perceives identity, expression, and facial motion. However, progress in fMRI-ba…
MindVoice: Reconstructing Intelligible Speech from Non-invasive Neural Signals with Pretrained Priors
Guangyin Bao, Taiping Zeng, Jianfeng Feng +1
Reconstructing continuous speech from non-invasive neural recordings is a fundamental problem for probing human auditory perception and building safe, scalable speech brain-compute…
Conformal Reliability: A New Evaluation Metric for Conditional Generation
Yachen Gao, Xinwei Sun, Yikai Wang +4
Conditional generative models have recently achieved remarkable success in various applications. However, a suitable metric for evaluating the reliability of these models, which ta…
The Pictorial Cortex: Zero-Shot Cross-Subject fMRI-to-Image Reconstruction via Compositional Latent Modeling
Jingyang Huo, Yikai Wang, Yanwei Fu +1
Decoding visual experiences from human brain activity remains a central challenge at the intersection of neuroscience, neuroimaging, and artificial intelligence. A critical obstacl…
LongVie 2: Multimodal Controllable Ultra-Long Video World Model
Jianxiong Gao, Zhaoxi Chen, Xian Liu +7
Building video world models upon pretrained video generation systems represents an important yet challenging step toward general spatiotemporal intelligence. A world model should p…
CineBrain: A Large-Scale Multi-Modal Brain Dataset During Naturalistic Audiovisual Narrative Processing
Jianxiong Gao, Yichang Liu, Baofeng Yang +2
Most research decoding brain signals into images, often using them as priors for generative models, has focused only on visual content. This overlooks the brain's natural ability t…