Facial Affect Estimation in the Wild Using Deep Residual and Convolutional Networks
arXiv:1705.07884 · doi:10.1109/CVPRW.2017.245
Abstract
Automated affective computing in the wild is a challenging task in the field of computer vision. This paper presents three neural network-based methods proposed for the task of facial affect estimation submitted to the First Affect-in-the-Wild challenge. These methods are based on Inception-ResNet modules redesigned specifically for the task of facial affect estimation. These methods are: Shallow Inception-ResNet, Deep Inception-ResNet, and Inception-ResNet with LSTMs. These networks extract facial features in different scales and simultaneously estimate both the valence and arousal in each frame. Root Mean Square Error (RMSE) rates of 0.4 and 0.3 are achieved for the valence and arousal respectively with corresponding Concordance Correlation Coefficient (CCC) rates of 0.04 and 0.29 using Deep Inception-ResNet method.
arXiv commentTo appear in 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
References in corpus (6)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
- Going Deeper in Facial Expression Recognition using Deep Neural Networks
- AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and Challenge
- Facial Expression Recognition from World Wild Web
- Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields
Cited by in corpus (4)
- Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond
- PersEmoN: A Deep Network for Joint Analysis of Apparent Personality, Emotion and Their Relationship
- BReG-NeXt: Facial Affect Computing Using Adaptive Residual Networks With Bounded Gradient
- Bounded Residual Gradient Networks (BReG-Net) for Facial Affect Computing