4 papers
AdaLTM: Adaptive Layer-wise Task Vector Merging for Categorical Speech Emotion Recognition with ASR Knowledge Integration
Chia-Yu Lee, Huang-Cheng Chou, Tzu-Quan Lin +4
Integrating Automatic Speech Recognition (ASR) into Speech Emotion Recognition (SER) enhances modeling by providing linguistic context. However, conventional feature fusion faces p…
RE-LLM: Refining Empathetic Speech-LLM Responses by Integrating Emotion Nuance
Jing-Han Chen, Bo-Hao Su, Ya-Tse Wu +1
With generative AI advancing, empathy in human-AI interaction is essential. While prior work focuses on emotional reflection, emotional exploration, key to deeper engagement, remai…
ASR for Affective Speech: Investigating Impact of Emotion and Speech Generative Strategy
Ya-Tse Wu, Chi-Chun Lee
This work investigates how emotional speech and generative strategies affect ASR performance. We analyze speech synthesized from three emotional TTS models and find that substituti…
Lessons Learnt: Revisit Key Training Strategies for Effective Speech Emotion Recognition in the Wild
Jing-Tong Tzeng, Bo-Hao Su, Ya-Tse Wu +2
In this study, we revisit key training strategies in machine learning often overlooked in favor of deeper architectures. Specifically, we explore balancing strategies, activation f…