CAKE: Compact and Accurate K-dimensional representation of Emotion

Abstract

Numerous models describing the human emotional states have been built by the psychology community. Alongside, Deep Neural Networks (DNN) are reaching excellent performances and are becoming interesting features extraction tools in many computer vision tasks.Inspired by works from the psychology community, we first study the link between the compact two-dimensional representation of the emotion known as arousal-valence, and discrete emotion classes (e.g. anger, happiness, sadness, etc.) used in the computer vision community. It enables to assess the benefits -- in terms of discrete emotion inference -- of adding an extra dimension to arousal-valence (usually named dominance). Building on these observations, we propose CAKE, a 3-dimensional representation of emotion learned in a multi-domain fashion, achieving accurate emotion recognition on several public datasets. Moreover, we visualize how emotions boundaries are organized inside DNN representations and show that DNNs are implicitly learning arousal-valence-like descriptions of emotions. Finally, we use the CAKE representation to compare the quality of the annotations of different public datasets.

References in corpus (2)

• Challenges in Representation Learning: A report on three machine learning contests
• Do Deep Neural Networks Learn Facial Action Units When Doing Expression Recognition?

Cited by in corpus (4)

• Facial expression and attributes recognition based on multi-task learning of lightweight neural networks
• Exploiting Emotional Dependencies with Graph Convolutional Networks for Facial Expression Recognition
• Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition
• The Many Moods of Emotion