Automatic Facial Expression Recognition Using Features of Salient Facial Patches

Abstract

Extraction of discriminative features from salient facial patches plays a vital role in effective facial expression recognition. The accurate detection of facial landmarks improves the localization of the salient patches on face images. This paper proposes a novel framework for expression recognition by using appearance features of selected facial patches. A few prominent facial patches, depending on the position of facial landmarks, are extracted which are active during emotion elicitation. These active patches are further processed to obtain the salient patches which contain discriminative features for classification of each pair of expressions, thereby selecting different facial patches as salient for different pair of expression classes. One-against-one classification method is adopted using these features. In addition, an automated learning-free facial landmark detection technique has been proposed, which achieves similar performances as that of other state-of-art landmark detection methods, yet requires significantly less execution time. The proposed method is found to perform well consistently in different resolutions, hence, providing a solution for expression recognition in low resolution images. Experiments on CK+ and JAFFE facial expression databases show the effectiveness of the proposed system.

References in corpus (1)

• A Real Time Facial Expression Classification System Using Local Binary Patterns

Cited by in corpus (18)

• Facial Expression Recognition with Visual Transformers and Attentional Selective Fusion
• Vision Transformer with Attentive Pooling for Robust Facial Expression Recognition
• DeXpression: Deep Convolutional Neural Network for Expression Recognition
• Spontaneous Subtle Expression Detection and Recognition based on Facial Strain
• Phoneme-to-viseme mappings: the good, the bad, and the ugly
• Advanced local motion patterns for macro and micro facial expression recognition
• EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddings
• Multi-task, multi-label and multi-domain learning with residual convolutional networks for emotion recognition
• Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
• Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks
• Your "Attention" Deserves Attention: A Self-Diversified Multi-Channel Attention for Facial Action Analysis
• A Fine-Grained Facial Expression Database for End-to-End Multi-Pose Facial Expression Recognition
• Learning to Augment Expressions for Few-shot Fine-grained Facial Expression Recognition
• A New Terrain in HCI: Emotion Recognition Interface using Biometric Data for an Immersive VR Experience
• Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition
• SenTion: A framework for Sensing Facial Expressions
• Face Detection, Bounding Box Aggregation and Pose Estimation for Robust Facial Landmark Localisation in the Wild
• Adaptively Enhancing Facial Expression Crucial Regions via Local Non-Local Joint Network