8 papers
How Attention Shapes Emotion: A Comparative Study of Attention Mechanisms for Speech Emotion Recognition
Marc Casals-Salvador, Federico Costa, Rodolfo Zevallos +1
Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due…
Quantifying Cross-Lingual Transfer in Paralinguistic Speech Tasks
Pol Buitrago, Oriol Pareras, Federico Costa +1
Paralinguistic speech tasks are often considered relatively language-agnostic, as they rely on extralinguistic acoustic cues rather than lexical content. However, prior studies rep…
Revisiting Direct Speech-to-Text Translation with Speech LLMs: Better Scaling than CoT Prompting?
Oriol Pareras, Gerard I. Gállego, Gerard I. Gállego +4
Recent work on Speech-to-Text Translation (S2TT) has focused on LLM-based models, introducing the increasingly adopted Chain-of-Thought (CoT) prompting, where the model is guided t…
Listening or Reading? Evaluating Speech Awareness in Chain-of-Thought Speech-to-Text Translation
Jacobo Romero-DÃaz, Jacobo Romero-Díaz, Gerard I. Gállego +6
Speech-to-Text Translation (S2TT) systems built from Automatic Speech Recognition (ASR) and Text-to-Text Translation (T2TT) modules face two major limitations: error propagation an…
On the Use of Audio to Improve Dialogue Policies
Daniel Roncel, Federico Costa, Javier Hernando
With the significant progress of speech technologies, spoken goal-oriented dialogue systems are becoming increasingly popular. One of the main modules of a dialogue system is typic…
BSC-UPC at EmoSPeech-IberLEF2024: Attention Pooling for Emotion Recognition
Marc Casals-Salvador, Federico Costa, Miquel India +1
The domain of speech emotion recognition (SER) has persistently been a frontier within the landscape of machine learning. It is an active field that has been revolutionized in the…