Towards a General Deep Feature Extractor for Facial Expression Recognition

Abstract

The human face conveys a significant amount of information. Through facial expressions, the face is able to communicate numerous sentiments without the need for verbalisation. Visual emotion recognition has been extensively studied. Recently several end-to-end trained deep neural networks have been proposed for this task. However, such models often lack generalisation ability across datasets. In this paper, we propose the Deep Facial Expression Vector ExtractoR (DeepFEVER), a new deep learning-based approach that learns a visual feature extractor general enough to be applied to any other facial emotion recognition task or dataset. DeepFEVER outperforms state-of-the-art results on the AffectNet and Google Facial Expression Comparison datasets. DeepFEVER's extracted features also generalise extremely well to other datasets -- even those unseen during training -- namely, the Real-World Affective Faces (RAF) dataset.

arXiv commentPublished in: 2021 IEEE International Conference on Image Processing (ICIP). arXiv admin note: text overlap with arXiv:2103.09154

References in corpus (7)

• Scikit-learn: Machine Learning in Python
• Distilling the Knowledge in a Neural Network
• FaceNet: A Unified Embedding for Face Recognition and Clustering
• Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks
• AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
• Local Learning with Deep and Handcrafted Features for Facial Expression Recognition
• Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network