4 papers
AdaLTM: Adaptive Layer-wise Task Vector Merging for Categorical Speech Emotion Recognition with ASR Knowledge Integration
Chia-Yu Lee, Huang-Cheng Chou, Tzu-Quan Lin +4
Integrating Automatic Speech Recognition (ASR) into Speech Emotion Recognition (SER) enhances modeling by providing linguistic context. However, conventional feature fusion faces p…
Bridging the Age Gap: Towards Detecting Neural Audio Codec Synthesized Elderly Speech Deepfake
Orchid Chetia Phukan, Girish, Mohd Mujtaba Akhtar +1
In this study, we introduce the Elderly CodecFake Detection (ECFD) task and release the Elderly-CodecFake (ECF) dataset in English and Chinese. We show that state-of-the-art CF det…
RE-LLM: Refining Empathetic Speech-LLM Responses by Integrating Emotion Nuance
Jing-Han Chen, Bo-Hao Su, Ya-Tse Wu +1
With generative AI advancing, empathy in human-AI interaction is essential. While prior work focuses on emotional reflection, emotional exploration, key to deeper engagement, remai…
ASR for Affective Speech: Investigating Impact of Emotion and Speech Generative Strategy
Ya-Tse Wu, Chi-Chun Lee
This work investigates how emotional speech and generative strategies affect ASR performance. We analyze speech synthesized from three emotional TTS models and find that substituti…