Learning Social Relation Traits from Face Images

Abstract

Social relation defines the association, e.g, warm, friendliness, and dominance, between two or more people. Motivated by psychological studies, we investigate if such fine-grained and high-level relation traits can be characterised and quantified from face images in the wild. To address this challenging problem we propose a deep model that learns a rich face representation to capture gender, expression, head pose, and age-related attributes, and then performs pairwise-face reasoning for relation prediction. To learn from heterogeneous attribute sources, we formulate a new network architecture with a bridging layer to leverage the inherent correspondences among these datasets. It can also cope with missing target attribute labels. Extensive experiments show that our approach is effective for fine-grained social relation learning in images and videos.

To appear in International Conference on Computer Vision (ICCV) 2015

Cited by in corpus (10)

• Deep Facial Expression Recognition: A Survey
• Local Learning with Deep and Handcrafted Features for Facial Expression Recognition
• Facial Expression Recognition using Convolutional Neural Networks: State of the Art
• Facial Attributes: Accuracy and Adversarial Robustness
• Walk and Learn: Facial Attribute Representation Learning from Egocentric Video and Contextual Data
• From Facial Expression Recognition to Interpersonal Relation Prediction
• A Domain Based Approach to Social Relation Recognition
• Deep video gesture recognition using illumination invariants
• Did the Model Change? Efficiently Assessing Machine Learning API Shifts
• Dual-Glance Model for Deciphering Social Relationships