Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines

Abstract

Facial expressions are widely used in the behavioral interpretation of emotions, cognitive science, and social interactions. In this paper, we present a novel method for fully automatic facial expression recognition in facial image sequences. As the facial expression evolves over time facial landmarks are automatically tracked in consecutive video frames, using displacements based on elastic bunch graph matching displacement estimation. Feature vectors from individual landmarks, as well as pairs of landmarks tracking results are extracted, and normalized, with respect to the first frame in the sequence. The prototypical expression sequence for each class of facial expression is formed, by taking the median of the landmark tracking results from the training facial expression sequences. Multi-class AdaBoost with dynamic time warping similarity distance between the feature vector of input facial expression and prototypical facial expression, is used as a weak classifier to select the subset of discriminative feature vectors. Finally, two methods for facial expression recognition are presented, either by using multi-class AdaBoost with dynamic time warping, or by using support vector machine on the boosted feature vectors. The results on the Cohn-Kanade (CK+) facial expression database show a recognition accuracy of 95.17% and 97.35% using multi-class AdaBoost and support vector machines, respectively.

21 pages, Sensors Journal, facial expression recognition

References in corpus (1)

• Faster Retrieval with a Two-Pass Dynamic-Time-Warping Lower Bound

Cited by in corpus (13)

• Vision Transformer with Attentive Pooling for Robust Facial Expression Recognition
• Facial expression recognition based on local region specific features and support vector machines
• Recognition of facial expressions based on salient geometric features and support vector machines
• Advanced local motion patterns for macro and micro facial expression recognition
• Facial emotion recognition using min-max similarity classifier
• Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks
• Multi-Branch Deep Radial Basis Function Networks for Facial Emotion Recognition
• Improving Facial Emotion Recognition Systems Using Gradient and Laplacian Images
• SenTion: A framework for Sensing Facial Expressions
• MAFER: a Multi-resolution Approach to Facial Expression Recognition
• Facial Emotion Recognition: A multi-task approach using deep learning
• A Multi-resolution Approach to Expression Recognition in the Wild
• Domain Adaptation for Facial Expression Classifier via Domain Discrimination and Gradient Reversal