94 citations · 404 across the 53 of their papers we have counts for
17 papers · 1 filter
FlowFace++: Explicit Semantic Flow-supervised End-to-End Face Swapping
Yu Zhang, Hao Zeng, Bowen Ma +5
This work proposes a novel face-swapping framework FlowFace++, utilizing explicit semantic flow supervision and end-to-end architecture to facilitate shape-aware face-swapping. Spe…
TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles
Yifeng Ma, Suzhen Wang, Yu Ding +6
Audio-driven talking head generation has drawn growing attention. To produce talking head videos with desired facial expressions, previous methods rely on extra reference videos to…
Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglement
Xingqun Qi, Chen Liu, Muyi Sun +3
Predicting natural and diverse 3D hand gestures from the upper body dynamics is a practical yet challenging task in virtual avatar creation. Previous works usually overlook the asy…
DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Video
Zhimeng Zhang, Zhipeng Hu, Wenjin Deng +3
For few-shot learning, it is still a critical challenge to realize photo-realistic face visually dubbing on high-resolution videos. Previous works fail to generate high-fidelity du…
Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation
Rui Zhao, Wei Li, Zhipeng Hu +4
Recent popular Role-Playing Games (RPGs) saw the great success of character auto-creation systems. The bone-driven face model controlled by continuous parameters (like the position…
NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field Indirect Illumination
Haoqian Wu, Zhipeng Hu, Lincheng Li +3
Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images. In order to achieve better decomposition, recent approaches attempt to mo…
StyleTalk: One-shot Talking Head Generation with Controllable Speaking Styles
Yifeng Ma, Suzhen Wang, Zhipeng Hu +5
Different people speak with diverse personalized speaking styles. Although existing one-shot talking head methods have made significant progress in lip sync, natural facial express…
FlowFace: Semantic Flow-guided Shape-aware Face Swapping
Hao Zeng, Wei Zhang, Changjie Fan +7
In this work, we propose a semantic flow-guided two-stage framework for shape-aware face swapping, namely FlowFace. Unlike most previous methods that focus on transferring the sour…
Facial Action Unit Detection and Intensity Estimation from Self-supervised Representation
Bowen Ma, Rudong An, Wei Zhang +6
As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming…
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion
Suzhen Wang, Lincheng Li, Yu Ding +2
We propose an audio-driven talking-head method to generate photo-realistic talking-head videos from a single reference image. In this work, we tackle two key challenges: (i) produc…
Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation
Lincheng Li, Suzhen Wang, Zhimeng Zhang +4
In this paper, we propose a novel text-based talking-head video generation framework that synthesizes high-fidelity facial expressions and head motions in accordance with contextua…
Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer
Xinhui Song, Tianyang Shi, Zunlei Feng +5
Facial action unit (AU) intensity is an index to describe all visually discernible facial movements. Most existing methods learn intensity estimator with limited AU data, while the…
Neutral Face Game Character Auto-Creation via PokerFace-GAN
Tianyang Shi, Zhengxia Zou, Xinhui Song +4
Game character customization is one of the core features of many recent Role-Playing Games (RPGs), where players can edit the appearance of their in-game characters with their pref…
Fast and Robust Face-to-Parameter Translation for Game Character Auto-Creation
Tianyang Shi, Zhengxia Zou, Yi Yuan +1
With the rapid development of Role-Playing Games (RPGs), players are now allowed to edit the facial appearance of their in-game characters with their preferences rather than using…
Unsupervised Facial Action Unit Intensity Estimation via Differentiable Optimization
Xinhui Song, Tianyang Shi, Tianjia Shao +3
The automatic intensity estimation of facial action units (AUs) from a single image plays a vital role in facial analysis systems. One big challenge for data-driven AU intensity es…
Multi-label Relation Modeling in Facial Action Units Detection
Xianpeng Ji, Yu Ding, Lincheng Li +2
This paper describes an approach to the facial action units detections. The involved action units (AU) include AU1 (Inner Brow Raiser), AU2 (Outer Brow Raiser), AU4 (Brow Lowerer),…
FReeNet: Multi-Identity Face Reenactment
Jiangning Zhang, Xianfang Zeng, Mengmeng Wang +5
This paper presents a novel multi-identity face reenactment framework, named FReeNet, to transfer facial expressions from an arbitrary source face to a target face with a shared mo…