93 citations · 223 across the 52 of their papers we have counts for
10 papers · 1 filter
Differentiable and Severity-invariant Discrete Tokens for Dysarthric Speech Recognition
Huimeng Wang, Xurong Xie, Mengzhe Geng +5
This paper proposes novel differentiable and severity-invariant (DSI) discrete token approaches that are not only tightly integrated with downstream dysarthric speech recognition t…
Auditing generative audio calls for known-task audio-llm evaluation
Mengzhe Geng
Speech and audio LLMs are evaluated by comparing waveform predictions with predictions from an automatic speech recognition (ASR) transcript. For fixed closed-set tasks, this confl…
SURE-Voice: A Front-End Baseline for Speech-Evidence Filtering in Speech LLMs
Mengzhe Geng
Speech language models (speech LLMs) can generate plausible outputs from audio that contains no usable speech evidence. We study this failure as a pre-generation support-estimation…
AudioNoisePrints: Model-free audio watermarking using spatial correlation in flow matching TTS
Timothy Tin-Long, Jian Zhu, Aidan Pine +1
We present AudioNoisePrints, a training-free watermarking pipeline for flow matching and diffusion TTS models, which requires minimal extra computation during inference and does no…
Confidence Score Guided Incremental and Speaker Adaptive Pseudo-Labeling for Semi-Supervised Elderly Speech Recognition
Chengxi Deng, Xurong Xie, Shujie Hu +7
This paper proposes a novel confidence score guided incremental and speaker adaptive pseudo-labeling approach for semi-supervised elderly speech recognition. It facilitates higher-…
Decoding while Adapting: Zero-Shot Online Speaker Adaptation via Audio-Textual Prompts for Elderly Speech Recognition
Chengxi Deng, Xurong Xie, Shujie Hu +7
This paper proposes a novel cross-utterance audio-textual prompts based speaker adaptation approach for elderly speech recognition. It enables zero-shot, real-time adaptation to un…
Explainable and Trustworthy Speech Emotion Recognition Using Confidence Score and Reinforcement Learning Rectified Speech Emotion Descriptors
Youjun Chen, Xurong Xie, Mengzhe Geng +9
Explainable and trustworthy speech emotion recognition (SER) remains a challenging task to date, largely due to the scarcity of SER data with reliable speech emotion descriptor (SE…
Towards Personalized Federated Learning for Dysarthric Speech Recognition
Tao Zhong, Mengzhe Geng, Jiajun Deng +2
Speech recognition is challenging for dysarthric speakers. While federated learning (FL)-based ASR can be an effective tool for protecting privacy, it suffers from heterogeneity is…
Towards Data-free and Training-free Compression for Speech Foundation Models Using Parameter Clustering
Haoning Xu, Zhaoqing Li, Huimeng Wang +4
This paper presents a novel data-free and training-free compression approach for speech foundation models using channelwise clustering via k-means. More fine-grained, mixed sparsit…
Multi-Channel Speech Enhancement for Cocktail Party Speech Emotion Recognition
Youjun Chen, Guinan Li, Mengzhe Geng +9
This paper highlights the critical importance of multi-channel speech enhancement (MCSE) for speech emotion recognition (ER) in cocktail party scenarios. A multi-channel speech der…