Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition

Abstract

We present a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations. Firstly, multiple classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions exhibit themselves through multiple facial regions simultaneously, and the recognition requires a holistic approach by encoding high-order interactions among local features. To address these issues, we propose our DAN with three key components: Feature Clustering Network (FCN), Multi-head cross Attention Network (MAN), and Attention Fusion Network (AFN). The FCN extracts robust features by adopting a large-margin learning objective to maximize class separability. In addition, the MAN instantiates a number of attention heads to simultaneously attend to multiple facial areas and build attention maps on these regions. Further, the AFN distracts these attentions to multiple locations before fusing the attention maps to a comprehensive one. Extensive experiments on three public datasets (including AffectNet, RAF-DB, and SFEW 2.0) verified that the proposed method consistently achieves state-of-the-art facial expression recognition performance. Code will be made available at https://github.com/yaoing/DAN.

Paper appears in Biomimetics 2023, 8(2), 199

References in corpus (1)

• Facial expression and attributes recognition based on multi-task learning of lightweight neural networks

Cited by in corpus (6)

• Facial expression and attributes recognition based on multi-task learning of lightweight neural networks
• Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
• Expressive Speech-driven Facial Animation with controllable emotions
• GReFEL: Geometry-Aware Reliable Facial Expression Learning under Bias and Imbalanced Data Distribution
• ARBEx: Attentive Feature Extraction with Reliability Balancing for Robust Facial Expression Learning
• Weaknesses of Facial Emotion Recognition Systems