421 citations · 544 across the 18 of their papers we have counts for
21 papers
A Comprehensive Review of Multimodal Facial State Analysis: Tasks, Methods, and Resources
Xuri Ge, Tianshuo Zhang, Ruihan Li +6
Facial state analysis plays a crucial role in understanding human expressions, psychological modeling, and human computer interaction. Traditional unimodal vision-based methods are…
Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters?
Kaiwen Zheng, Junchen Fu, Wenhao Deng +3
Recent advances in multimodal large language models (MLLMs) have significantly improved the performance of multimodal emotion recognition (MER) and enabled interpretable descriptio…
Affective Behaviour Analysis Using Pretrained Model with Facial Priori
Yifan Li, Haomiao Sun, Zhaori Liu +1
Affective behaviour analysis has aroused researchers' attention due to its broad applications. However, it is labor exhaustive to obtain accurate annotations for massive face image…
MGRR-Net: Multi-level Graph Relational Reasoning Network for Facial Action Units Detection
Xuri Ge, Joemon M. Jose, Songpei Xu +2
The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression an…
Automatic Facial Paralysis Estimation with Facial Action Units
Xuri Ge, Joemon M. Jose, Pengcheng Wang +3
Facial palsy is unilateral facial nerve weakness or paralysis of rapid onset with unknown causes. Automatically estimating facial palsy severeness can be helpful for the diagnosis…
Where is the disease? Semi-supervised pseudo-normality synthesis from an abnormal image
Yuanqi Du, Quan Quan, Hu Han +1
Pseudo-normality synthesis, which computationally generates a pseudo-normal image from an abnormal one (e.g., with lesions), is critical in many perspectives, from lesion detection…
Conditional Training with Bounding Map for Universal Lesion Detection
Han Li, Long Chen, Hu Han +1
Universal Lesion Detection (ULD) in computed tomography plays an essential role in computer-aided diagnosis. Promising ULD results have been reported by coarse-to-fine two-stage de…
Deep Learning to Segment Pelvic Bones: Large-scale CT Datasets and Baseline Models
Pengbo Liu, Hu Han, Yuanqi Du +9
Purpose: Pelvic bone segmentation in CT has always been an essential step in clinical diagnosis and surgery planning of pelvic bone diseases. Existing methods for pelvic bone segme…
Bounding Maps for Universal Lesion Detection
Han Li, Hu Han, S. Kevin Zhou
Universal Lesion Detection (ULD) in computed tomography plays an essential role in computer-aided diagnosis systems. Many detection approaches achieve excellent results for ULD usi…
Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling
Xuesong Niu, Zitong Yu, Hu Han +3
Remote physiological measurements, e.g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playin…
Miss the Point: Targeted Adversarial Attack on Multiple Landmark Detection
Qingsong Yao, Zecheng He, Hu Han +1
Recent methods in multiple landmark detection based on deep convolutional neural networks (CNNs) reach high accuracy and improve traditional clinical workflow. However, the vulnera…
Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learning
Guoqing Wang, Hu Han, Shiguang Shan +1
Face presentation attack detection (PAD) has been an urgent problem to be solved in the face recognition systems. Conventional approaches usually assume the testing and training ar…
The 1st Challenge on Remote Physiological Signal Sensing (RePSS)
Xiaobai Li, Hu Han, Hao Lu +5
Remote measurement of physiological signals from videos is an emerging topic. The topic draws great interests, but the lack of publicly available benchmark databases and a fair val…
FCSR-GAN: Joint Face Completion and Super-resolution via Multi-task Learning
Jiancheng Cai, Hu Han, Shiguang Shan +1
Combined variations containing low-resolution and occlusion often present in face images in the wild, e.g., under the scenario of video surveillance. While most of the existing fac…
RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation
Xuesong Niu, Shiguang Shan, Hu Han +1
Heart rate (HR) is an important physiological signal that reflects the physical and emotional status of a person. Traditional HR measurements usually rely on contact monitors, whic…
Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition
Xuesong Niu, Hu Han, Shiguang Shan +1
Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big f…
Encoding CT Anatomy Knowledge for Unpaired Chest X-ray Image Decomposition
Zeju Li, Han Li, Hu Han +3
Although chest X-ray (CXR) offers a 2D projection with overlapped anatomies, it is widely used for clinical diagnosis. There is clinical evidence supporting that decomposing an X-r…
3D U-Net: A 3D Universal U-Net for Multi-Domain Medical Image Segmentation
Chao Huang, Hu Han, Qingsong Yao +2
Fully convolutional neural networks like U-Net have been the state-of-the-art methods in medical image segmentation. Practically, a network is highly specialized and trained separa…
VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video
Xuesong Niu, Hu Han, Shiguang Shan +1
Heart rate (HR) is an important physiological signal that reflects the physical and emotional activities of humans. Traditional HR measurements are mainly based on contact monitors…
Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning
Hu Han, Jie Li, Anil K. Jain +2
The explosive growth of digital images in video surveillance and social media has led to the significant need for efficient search of persons of interest in law enforcement and for…
Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach
Hu Han, Anil K. Jain, Fang Wang +2
Face attribute estimation has many potential applications in video surveillance, face retrieval, and social media. While a number of methods have been proposed for face attribute e…