ComFace: Facial Representation Learning with Synthetic Data for Comparing Faces

Abstract

Daily monitoring of intra-personal facial changes associated with health and emotional conditions has great potential to be useful for medical, healthcare, and emotion recognition fields. However, the approach for capturing intra-personal facial changes is relatively unexplored due to the difficulty of collecting temporally changing face images. In this paper, we propose a facial representation learning method using synthetic images for comparing faces, called ComFace, which is designed to capture intra-personal facial changes. For effective representation learning, ComFace aims to acquire two feature representations, i.e., inter-personal facial differences and intra-personal facial changes. The key point of our method is the use of synthetic face images to overcome the limitations of collecting real intra-personal face images. Facial representations learned by ComFace are transferred to three extensive downstream tasks for comparing faces: estimating facial expression changes, weight changes, and age changes from two face images of the same individual. Our ComFace, trained using only synthetic data, achieves comparable to or better transfer performance than general pre-training and state-of-the-art representation learning methods trained using real images.

Accepted to IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025

References in corpus (7)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Deep Facial Expression Recognition: A Survey
• Deep Face Recognition: A Survey
• Alias-Free Generative Adversarial Networks
• Eigen-CAM: Class Activation Map using Principal Components
• StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows
• Edema Estimation From Facial Images Taken Before and After Dialysis via Contrastive Multi-Patient Pre-Training