5 papers
Automated Assessment of L2 Speech Rhythm Using Low-Frequency Amplitude Modulations
João Lima, Lucas Ueda, Paula Costa
Automated Speaking Assessment of non-native speech must effectively evaluate prosody, including speech rhythm, to align with human perception. However, commonly employed rhythm met…
Crab: Multi Layer Contrastive Supervision to Improve Speech Emotion Recognition Under Both Acted and Natural Speech Condition
Lucas H. Ueda, João G. T. Lima, Paula D. P. Costa
Speech Emotion Recognition (SER) in real-world scenarios remains challenging due to severe class imbalance and the prevalence of spontaneous, natural speech. While recent approache…
SelfTTS: cross-speaker style transfer through explicit embedding disentanglement and self-refinement using self-augmentation
Lucas H. Ueda, João G. T. Lima, Pedro R. Corrêa +3
This work presents SelfTTS, a text-to-speech (TTS) model designed for cross-speaker style transfer that eliminates the need for external pre-trained speaker or emotion encoders. Th…
Evaluating Emotion Recognition in Spoken Language Models on Emotionally Incongruent Speech
Pedro Corrêa, João Lima, Victor Moreno +2
Advancements in spoken language processing have driven the development of spoken language models (SLMs), designed to achieve universal audio understanding by jointly learning text…
Improving Speech Emotion Recognition Through Cross Modal Attention Alignment and Balanced Stacking Model
Lucas Ueda, João Lima, Leonardo Marques +1
Emotion plays a fundamental role in human interaction, and therefore systems capable of identifying emotions in speech are crucial in the context of human-computer interaction. Spe…