A Personalized Affective Memory Neural Model for Improving Emotion Recognition
arXiv:1904.12632
Abstract
Recent models of emotion recognition strongly rely on supervised deep learning solutions for the distinction of general emotion expressions. However, they are not reliable when recognizing online and personalized facial expressions, e.g., for person-specific affective understanding. In this paper, we present a neural model based on a conditional adversarial autoencoder to learn how to represent and edit general emotion expressions. We then propose Grow-When-Required networks as personalized affective memories to learn individualized aspects of emotion expressions. Our model achieves state-of-the-art performance on emotion recognition when evaluated on \textit{in-the-wild} datasets. Furthermore, our experiments include ablation studies and neural visualizations in order to explain the behavior of our model.
arXiv commentAccepted by the International Conference on Machine Learning 2019 (ICML2019)
References in corpus (10)
- Deep Learning in Neural Networks: An Overview
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
- Age Progression/Regression by Conditional Adversarial Autoencoder
- Deep generative-contrastive networks for facial expression recognition
- FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition
- A Deep Network for Arousal-Valence Emotion Prediction with Acoustic-Visual Cues
- Multimodal Emotion Recognition for One-Minute-Gradual Emotion Challenge
- Geometry Guided Adversarial Facial Expression Synthesis
- Unsupervised Deep Representations for Learning Audience Facial Behaviors