8 papers
Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition
Masoumeh Sharafi, Muhammad Osama Zeeshan, Soufiane Belharbi +3
Facial expression recognition (FER) in videos is challenging because models must identify subtle, temporally evolving affective states that vary across individuals. Although vision…
Test-Time Adaptation via Cache Personalization for Facial Expression Recognition in Videos
Masoumeh Sharafi, Muhammad Osama Zeeshan, Soufiane Belharbi +3
Facial expression recognition (FER) in videos requires model personalization to capture considerable variations across subjects. Vision-language models (VLMs) offer strong transfer…
Multimodal Ambivalence/Hesitancy Recognition in Videos for Personalized Digital Health Interventions
Manuela González-González, Soufiane Belharbi, Muhammad Osama Zeeshan +8
Using behavioural science, health interventions focus on behaviour change by providing a framework to help patients acquire and maintain healthy habits that improve medical outcome…
CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition
Muhammad Osama Zeeshan, Masoumeh Sharafi, Benoit Savary +3
Personalization in emotion recognition (ER) is essential for accurate interpretation of subtle and subject-specific expressive patterns. Recent advances in vision-language models (…
BAH Dataset for Ambivalence/Hesitancy Recognition in Videos for Digital Behavioural Change
Manuela González-González, Soufiane Belharbi, Muhammad Osama Zeeshan +6
Ambivalence and hesitancy (A/H), closely related constructs, are the primary reasons why individuals delay, avoid, or abandon health behaviour changes. They are subtle and conflict…
MuSACo: Multimodal Subject-Specific Selection and Adaptation for Expression Recognition with Co-Training
Muhammad Osama Zeeshan, Natacha Gillet, Alessandro Lameiras Koerich +3
Personalized expression recognition (ER) involves adapting a machine learning model to subject-specific data for improved recognition of expressions with considerable interpersonal…