Distribution-based Emotion Recognition in Conversation
arXiv:2211.04834 · doi:10.1109/SLT54892.2023.10022800
Abstract
Automatic emotion recognition in conversation (ERC) is crucial for emotion-aware conversational artificial intelligence. This paper proposes a distribution-based framework that formulates ERC as a sequence-to-sequence problem for emotion distribution estimation. The inherent ambiguity of emotions and the subjectivity of human perception lead to disagreements in emotion labels, which is handled naturally in our framework from the perspective of uncertainty estimation in emotion distributions. A Bayesian training loss is introduced to improve the uncertainty estimation by conditioning each emotional state on an utterance-specific Dirichlet prior distribution. Experimental results on the IEMOCAP dataset show that ERC outperformed the single-utterance-based system, and the proposed distribution-based ERC methods have not only better classification accuracy, but also show improved uncertainty estimation.
arXiv commentTo appear in SLT 2022
References in corpus (10)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Representation Learning with Contrastive Predictive Coding
- On the Opportunities and Risks of Foundation Models
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
- Multimodal Intelligence: Representation Learning, Information Fusion, and Applications
- Self-Supervised Speech Representation Learning: A Review
- Emotion recognition by fusing time synchronous and time asynchronous representations
- Aligned Contrastive Predictive Coding
- Combination of Deep Speaker Embeddings for Diarisation
- Estimating the Uncertainty in Emotion Class Labels with Utterance-Specific Dirichlet Priors