2 papers
q-bio.NC2023
Do self-supervised speech and language models extract similar representations as human brain?
Peili Chen, Linyang He, Li Fu +3
Speech and language models trained through self-supervised learning (SSL) demonstrate strong alignment with brain activity during speech and language perception. However, given the…
cs.SD2023
Neural2Speech: A Transfer Learning Framework for Neural-Driven Speech Reconstruction
Jiawei Li, Chunxu Guo, Li Fu +3
Reconstructing natural speech from neural activity is vital for enabling direct communication via brain-computer interfaces. Previous efforts have explored the conversion of neural…