184 citations · 678 across the 15 of their papers we have counts for
15 papers
A Layer-Anchoring Strategy for Enhancing Cross-Lingual Speech Emotion Recognition
Shreya G. Upadhyay, Carlos Busso, Chi-Chun Lee
Cross-lingual speech emotion recognition (SER) is important for a wide range of everyday applications. While recent SER research relies heavily on large pretrained models for emoti…
Versatile audio-visual learning for emotion recognition
Lucas Goncalves, Seong-Gyun Leem, Wei-Cheng Lin +2
Most current audio-visual emotion recognition models lack the flexibility needed for deployment in practical applications. We envision a multimodal system that works even when only…
Mixed-EVC: Mixed Emotion Synthesis and Control in Voice Conversion
Kun Zhou, Berrak Sisman, Carlos Busso +2
Emotional voice conversion (EVC) traditionally targets the transformation of spoken utterances from one emotional state to another, with previous research mainly focusing on discre…
Driving Anomaly Detection Using Conditional Generative Adversarial Network
Yuning Qiu, Teruhisa Misu, Carlos Busso
Anomaly driving detection is an important problem in advanced driver assistance systems (ADAS). It is important to identify potential hazard scenarios as early as possible to avoid…
Unsupervised Personalization of an Emotion Recognition System: The Unique Properties of the Externalization of Valence in Speech
Kusha Sridhar, Carlos Busso
The prediction of valence from speech is an important, but challenging problem. The externalization of valence in speech has speaker-dependent cues, which contribute to performance…
Estimation of Driver's Gaze Region from Head Position and Orientation using Probabilistic Confidence Regions
Sumit Jha, Carlos Busso
A smart vehicle should be able to understand human behavior and predict their actions to avoid hazardous situations. Specific traits in human behavior can be automatically predicte…
The Ambiguous World of Emotion Representation
Vidhyasaharan Sethu, Emily Mower Provost, Julien Epps +3
Artificial intelligence and machine learning systems have demonstrated huge improvements and human-level parity in a range of activities, including speech recognition, face recogni…
Report of 2017 NSF Workshop on Multimedia Challenges, Opportunities and Research Roadmaps
Shih-Fu Chang, Alex Hauptmann, Louis-Philippe Morency +18
With the transformative technologies and the rapidly changing global R&D landscape, the multimedia and multimodal community is now faced with many new opportunities and uncertainti…
Semi-Supervised Speech Emotion Recognition with Ladder Networks
Srinivas Parthasarathy, Carlos Busso
Speech emotion recognition (SER) systems find applications in various fields such as healthcare, education, and security and defense. A major drawback of these systems is their lac…
End-to-end Audiovisual Speech Activity Detection with Bimodal Recurrent Neural Models
Fei Tao, Carlos Busso
Speech activity detection (SAD) plays an important role in current speech processing systems, including automatic speech recognition (ASR). SAD is particularly difficult in environ…
Speech-Driven Expressive Talking Lips with Conditional Sequential Generative Adversarial Networks
Najmeh Sadoughi, Carlos Busso
Articulation, emotion, and personality play strong roles in the orofacial movements. To improve the naturalness and expressiveness of virtual agents (VAs), it is important that we…
Curriculum Learning for Speech Emotion Recognition from Crowdsourced Labels
Reza Lotfian, Carlos Busso
This study introduces a method to design a curriculum for machine-learning to maximize the efficiency during the training process of deep neural networks (DNNs) for speech emotion…
Ladder Networks for Emotion Recognition: Using Unsupervised Auxiliary Tasks to Improve Predictions of Emotional Attributes
Srinivas Parthasarathy, Carlos Busso
Recognizing emotions using few attribute dimensions such as arousal, valence and dominance provides the flexibility to effectively represent complex range of emotional behaviors. C…
Domain Adversarial for Acoustic Emotion Recognition
Mohammed Abdelwahab, Carlos Busso
The performance of speech emotion recognition is affected by the differences in data distributions between train (source domain) and test (target domain) sets used to build and eva…
Speech-driven Animation with Meaningful Behaviors
Najmeh Sadoughi, Carlos Busso
Conversational agents (CAs) play an important role in human computer interaction. Creating believable movements for CAs is challenging, since the movements have to be meaningful an…