Learning to Amend Facial Expression Representation via De-albino and Affinity
arXiv:2103.10189
Abstract
Facial Expression Recognition (FER) is a classification task that points to face variants. Hence, there are certain affinity features between facial expressions, receiving little attention in the FER literature. Convolution padding, despite helping capture the edge information, causes erosion of the feature map simultaneously. After multi-layer filling convolution, the output feature map named albino feature definitely weakens the representation of the expression. To tackle these challenges, we propose a novel architecture named Amending Representation Module (ARM). ARM is a substitute for the pooling layer. Theoretically, it can be embedded in the back end of any network to deal with the Padding Erosion. ARM efficiently enhances facial expression representation from two different directions: 1) reducing the weight of eroded features to offset the side effect of padding, and 2) decomposing facial features to simplify representation learning. Experiments on public benchmarks prove that our ARM boosts the performance of FER remarkably. The validation accuracies are respectively 90.42% on RAF-DB, 65.2% on Affect-Net, and 58.71% on SFEW, exceeding current state-of-the-art methods. Our implementation and trained models are available at https://github.com/JiaweiShiCV/Amend-Representation-Module.
References in corpus (7)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- A systematic study of the class imbalance problem in convolutional neural networks
- AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
- Going Deeper in Facial Expression Recognition using Deep Neural Networks
- Local Learning with Deep and Handcrafted Features for Facial Expression Recognition
Cited by in corpus (5)
- Facial expression and attributes recognition based on multi-task learning of lightweight neural networks
- Facial Emotion Recognition: State of the Art Performance on FER2013
- PAtt-Lite: Lightweight Patch and Attention MobileNet for Challenging Facial Expression Recognition
- Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition
- Uncover Common Facial Expressions in Terracotta Warriors: A Deep Learning Approach