Sparsity in Dynamics of Spontaneous Subtle Emotions: Analysis \& Application

Abstract

Spontaneous subtle emotions are expressed through micro-expressions, which are tiny, sudden and short-lived dynamics of facial muscles; thus poses a great challenge for visual recognition. The abrupt but significant dynamics for the recognition task are temporally sparse while the rest, irrelevant dynamics, are temporally redundant. In this work, we analyze and enforce sparsity constrains to learn significant temporal and spectral structures while eliminate irrelevant facial dynamics of micro-expressions, which would ease the challenge in the visual recognition of spontaneous subtle emotions. The hypothesis is confirmed through experimental results of automatic spontaneous subtle emotion recognition with several sparsity levels on CASME II and SMIC, the only two publicly available spontaneous subtle emotion databases. The overall performances of the automatic subtle emotion recognition are boosted when only significant dynamics are preserved from the original sequences.

arXiv commentIEEE Transaction of Affective Computing (2016)

References in corpus (2)

• Sparsity-promoting dynamic mode decomposition
• Dynamic Mode Decomposition for Real-Time Background/Foreground Separation in Video

Cited by in corpus (10)

• Less is More: Micro-expression Recognition from Video using Apex Frame
• A Survey of Automatic Facial Micro-expression Analysis: Databases, Methods and Challenges
• MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolution
• Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-expressions
• Artificial Intelligence can Recognize Whether a Job Applicant is Selling and/or Lying According to Facial Expressions and Head Movements Much More Correctly Than Human Interviewers
• Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition
• Evaluation of the Spatio-Temporal features and GAN for Micro-expression Recognition System
• Reduced-order modeling using Dynamic Mode Decomposition and Least Angle Regression
• Micro-Expression Recognition via Fine-Grained Dynamic Perception
• Cross-Database Micro-Expression Recognition: A Benchmark