Synthetic Thermal and RGB Videos for Automatic Pain Assessment utilizing a Vision-MLP Architecture

Abstract

Pain assessment is essential in developing optimal pain management protocols to alleviate suffering and prevent functional decline in patients. Consequently, reliable and accurate automatic pain assessment systems are essential for continuous and effective patient monitoring. This study presents synthetic thermal videos generated by Generative Adversarial Networks integrated into the pain recognition pipeline and evaluates their efficacy. A framework consisting of a Vision-MLP and a Transformer-based module is utilized, employing RGB and synthetic thermal videos in unimodal and multimodal settings. Experiments conducted on facial videos from the BioVid database demonstrate the effectiveness of synthetic thermal videos and underline the potential advantages of it.

References in corpus (4)

• Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks
• AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
• A Full Transformer-based Framework for Automatic Pain Estimation using Videos
• Multi-task Neural Networks for Pain Intensity Estimation using Electrocardiogram and Demographic Factors