421 citations · 633 across the 10 of their papers we have counts for
10 papers
GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computing
Hao Lu, Xuesong Niu, Jiyao Wang +12
Multimodal large language models (MLLMs) are designed to process and integrate information from multiple sources, such as text, speech, images, and videos. Despite its success in l…
Multi-scale Promoted Self-adjusting Correlation Learning for Facial Action Unit Detection
Xin Liu, Kaishen Yuan, Xuesong Niu +4
Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically,…
Neuron Structure Modeling for Generalizable Remote Physiological Measurement
Hao Lu, Zitong Yu, Xuesong Niu +1
Remote photoplethysmography (rPPG) technology has drawn increasing attention in recent years. It can extract Blood Volume Pulse (BVP) from facial videos, making many applications l…
Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling
Xuesong Niu, Zitong Yu, Hu Han +3
Remote physiological measurements, e.g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playin…
Face Anti-Spoofing with Human Material Perception
Zitong Yu, Xiaobai Li, Xuesong Niu +2
Face anti-spoofing (FAS) plays a vital role in securing the face recognition systems from presentation attacks. Most existing FAS methods capture various cues (e.g., texture, depth…
AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching
Zitong Yu, Xiaobai Li, Xuesong Niu +2
Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e.g., remote healthcare). Existing end-t…
The 1st Challenge on Remote Physiological Signal Sensing (RePSS)
Xiaobai Li, Hu Han, Hao Lu +5
Remote measurement of physiological signals from videos is an emerging topic. The topic draws great interests, but the lack of publicly available benchmark databases and a fair val…
RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation
Xuesong Niu, Shiguang Shan, Hu Han +1
Heart rate (HR) is an important physiological signal that reflects the physical and emotional status of a person. Traditional HR measurements usually rely on contact monitors, whic…
Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition
Xuesong Niu, Hu Han, Shiguang Shan +1
Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big f…
VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video
Xuesong Niu, Hu Han, Shiguang Shan +1
Heart rate (HR) is an important physiological signal that reflects the physical and emotional activities of humans. Traditional HR measurements are mainly based on contact monitors…