8 papers
Strength-Parity Ensembling with Parameter-Isolated Experts for Multi-Task Affect Recognition
Tung Hung Bui, Hong Hai Nguyen, Van Thong Huynh
Leading entries on the multi-task track of the 11th ABAW challenge rely on heavy ensembling, yet which member is worth adding to an already strong ensemble is rarely made explicit.…
CF-Net: Conflict Fusion with Speaker Normalisation and Certainty Weighting for Ambivalence/Hesitancy Recognition
Tung Hung Bui, Hong Hai Nguyen, Van Thong Huynh
Detecting ambivalence and hesitancy (AH) in unconstrained video is challenging because the target signal is inherently ambiguous and expressed through subtle cross-modal incongruen…
A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognition
Hong Hai Nguyen, Sy Phan Van, Soo-Hyung Kim +1
Facial affect in the wild is naturally multi-task: valence-arousal, discrete expressions, and facial action units describe the same face. Yet real corpora annotate these tasks only…
Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations
Van Thong Huynh, Hong Hai Nguyen, Thuy Pham +2
Multimodal models can name the action units (AUs) behind a facial emotion, but their AU->emotion rationales are typically plausible rather than faithful: nothing forces the AUs a m…
The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition
Van Thong Huynh, Hong Hai Nguyen, Soo-Hyung Kim
In-the-wild expression recognition persistently fails on a few rare emotions, and the standard explanation is class imbalance. Through a controlled multi-task study on two benchmar…
Lightweight Models for Emotional Analysis in Video
Quoc-Tien Nguyen, Hong-Hai Nguyen, Van-Thong Huynh
In this study, we present an approach for efficient spatiotemporal feature extraction using MobileNetV4 and a multi-scale 3D MLP-Mixer-based temporal aggregation module. MobileNetV…
Mental Workload Estimation with Electroencephalogram Signals by Combining Multi-Space Deep Models
Hong-Hai Nguyen, Ngumimi Karen Iyortsuun, Seungwon Kim +2
The human brain remains continuously active, whether an individual is working or at rest. Mental activity is a daily process, and if the brain becomes excessively active, known as…
Facial Expression Classification using Fusion of Deep Neural Network in Video for the 3rd ABAW3 Competition
Kim Ngan Phan, Hong-Hai Nguyen, Van-Thong Huynh +1
For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis…