Publications (11)
AUD-TGN: Advancing Action Unit Detection with Temporal Convolution and GPT-2 in Wild Audiovisual Contexts
Jun Yu, Zerui Zhang, Zhihong Wei +6
Leveraging the synergy of both audio data and visual data is essential for understanding human emotions and behaviors, especially in in-the-wild setting. Traditional methods for in…
Grand Challenge of 106-Point Facial Landmark Localization
Yinglu Liu, Hao Shen, Yue Si +18
Facial landmark localization is a very crucial step in numerous face related applications, such as face recognition, facial pose estimation, face image synthesis, etc. However, pre…
Retrieval of Family Members Using Siamese Neural Network
Jun Yu, Guochen Xie, Mengyan Li +1
Retrieval of family members in the wild aims at finding family members of the given subject in the dataset, which is useful in finding the lost children and analyzing the kinship.…
Multimodal Fusion Method with Spatiotemporal Sequences and Relationship Learning for Valence-Arousal Estimation
Jun Yu, Gongpeng Zhao, Yongqi Wang +7
This paper presents our approach for the VA (Valence-Arousal) estimation task in the ABAW6 competition. We devised a comprehensive model by preprocessing video frames and audio seg…
Exploring Facial Expression Recognition through Semi-Supervised Pretraining and Temporal Modeling
Jun Yu, Zhihong Wei, Zhongpeng Cai +6
Facial Expression Recognition (FER) plays a crucial role in computer vision and finds extensive applications across various fields. This paper aims to present our approach for the…
BiSTF: Bilateral-Branch Self-Training Framework for Semi-Supervised Large-scale Fine-Grained Recognition
Hao Chang, Guochen Xie, Jun Yu +1
Semi-supervised Fine-Grained Recognition is a challenge task due to the difficulty of data imbalance, high inter-class similarity and domain mismatch. Recent years, this field has…
A Dual Branch Network for Emotional Reaction Intensity Estimation
Jun Yu, Jichao Zhu, Wangyuan Zhu +4
Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this pape…
Deep Fusion Siamese Network for Automatic Kinship Verification
Jun Yu, Mengyan Li, Xinlong Hao +1
Automatic kinship verification aims to determine whether some individuals belong to the same family. It is of great research significance to help missing persons reunite with their…
SAR2EO: A High-resolution Image Translation Framework with Denoising Enhancement
Jun Yu, Shenshen Du, Guochen Xie +4
Synthetic Aperture Radar (SAR) to electro-optical (EO) image translation is a fundamental task in remote sensing that can enrich the dataset by fusing information from different so…
Exploring Large-scale Unlabeled Faces to Enhance Facial Expression Recognition
Jun Yu, Zhongpeng Cai, Renda Li +4
Facial Expression Recognition (FER) is an important task in computer vision and has wide applications in human-computer interaction, intelligent security, emotion analysis, and oth…
Local Region Perception and Relationship Learning Combined with Feature Fusion for Facial Action Unit Detection
Jun Yu, Renda Li, Zhongpeng Cai +4
Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affecti…