13 citations · 14 across the 4 of their papers we have counts for
4 papers · 1 filter
Adapting Speech Foundation Models for Unified Multimodal Speech Recognition with Large Language Models
Jing-Xuan Zhang, Genshun Wan, Jin Li +3
While speech foundation models (SFMs) have demonstrated remarkable performance in audio-only tasks, their adaptation to multimodal scenarios remains underexplored. This work presen…
Geometry-Constrained EEG Channel Selection for Brain-Assisted Speech Enhancement
Keying Zuo, Qingtian Xu, Jie Zhang +1
Brain-assisted speech enhancement (BASE) aims to extract the target speaker in complex multi-talker scenarios using electroencephalogram (EEG) signals as an assistive modality, as…
Adversarial speech for voice privacy protection from Personalized Speech generation
Shihao Chen, Liping Chen, Jie Zhang +3
The rapid progress in personalized speech generation technology, including personalized text-to-speech (TTS) and voice conversion (VC), poses a challenge in distinguishing between…
Sparsity-Driven EEG Channel Selection for Brain-Assisted Speech Enhancement
Jie Zhang, Qing-Tian Xu, Zhen-Hua Ling +1
Speech enhancement is widely used as a front-end to improve the speech quality in many audio systems, while it is hard to extract the target speech in multi-talker conditions witho…