Decoding fMRI Data into Captions using Prefix Language Modeling

Vyacheslav Shen, Kassymzhomart Kunanbayev, Dae-Shik Kim

With the advancements in Large Language and Latent Diffusion models, brain decoding has achieved remarkable results in recent years. The works on the NSD dataset, with stimuli imag…