93 citations · 190 across the 38 of their papers we have counts for
39 papers
Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation
Baiqin Wang, Zhixing Ding, Jijie Li +3
In daily life, each person exhibits unique speaking habits, leading to subtle yet consistent lip-shape variations even when pronouncing the same word. Although recent talking head…
Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses
Jiankuo Zhao, Xiangyu Zhu, Jijie Li +3
Reconstructing expressive and relightable 3D head avatars from monocular videos remains challenging in computer vision, as it requires accurate modeling of both non-rigid facial mo…
Towards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation
Baiqin Wang, Sen Chen, Jiankuo Zhao +3
Conversational talking face generation has recently attracted increasing attention, aiming to synthesize interactive talking videos where characters speak, listen, and respond dyna…
Knowing You at First Glance: Inferring Apparent Personality from Faces
Shuhuan Chen, Xiangyu Zhu, Weisong Zhao +3
Inferring apparent personality from facial images is important in social scenarios for embodied agents in human-robot interaction. Unlike inferring intrinsic personality traits via…
The Devil Is in the Leakage: A Disentangled Dual-Purification Framework for High-Fidelity Hairstyle Transfer
Jijie Li, Jiankuo Zhao, Xiangyu Zhu +1
Hairstyle transfer aims to synthesize a photorealistic portrait by transplanting the hairstyle from a reference image onto a source subject while preserving the source identity. Re…
Adaptive 3D Convolution for Remote Sensing Image Fusion
Siran Peng, Xiangyu Zhu, Shang-Qi Deng +2
Remote sensing image fusion aims to create a high-resolution multi/hyper-spectral image from a high-resolution image with limited spectral information and a low-resolution image wi…
TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
Xiangyu Liu, Feng Gao, Xiaomei Zhang +4
Existing audio-driven video digital human generation models rely on multi-step denoising, resulting in substantial computational overhead that severely limits their deployment in r…
Direct Discrepancy Replay: Distribution-Discrepancy Condensation and Manifold-Consistent Replay for Continual Face Forgery Detection
Tianshuo Zhang, Haoyuan Zhang, Siran Peng +3
Continual face forgery detection (CFFD) requires detectors to learn emerging forgery paradigms without forgetting previously seen manipulations. Existing CFFD methods commonly rely…
GA-Field: Geometry-Aware Vehicle Aerodynamic Field Prediction
Zhenhua Zheng, Lu Zhang, Junhong Zou +4
Accurate aerodynamic field prediction is crucial for vehicle drag evaluation, but the computational cost of high-fidelity CFD hinders its use in iterative design workflows. While l…
EEA: Exploration-Exploitation Agent for Long Video Understanding
Te Yang, Xiangyu Zhu, Bo Wang +3
Long-form video understanding requires efficient navigation of extensive visual data to pinpoint sparse yet critical information. Current approaches to longform video understanding…
STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstruction
Jiankuo Zhao, Xiangyu Zhu, Zidu Wang +1
Reconstructing high-fidelity and animatable 3D head avatars from monocular videos remains a challenging yet essential task. Existing methods based on 3D Gaussian Splatting typicall…
UniField: Joint Multi-Domain Training for Universal Surface Pressure Modeling
Junhong Zou, Zhenxu Sun, Yueqing Wang +4
Accurate modeling of surface pressure fields around objects is fundamental to aerodynamic analysis and design. While neural networks have shown promise as efficient alternatives to…
Towards Realistic Hand-Object Interaction with Gravity-Field Based Diffusion Bridge
Miao Xu, Xiangyu Zhu, Xusheng Liang +3
Existing reconstruction or hand-object pose estimation methods are capable of producing coarse interaction states. However, due to the complex and diverse geometry of both human ha…
Pose-RFT: Enhancing MLLMs for 3D Pose Generation via Hybrid Action Reinforcement Fine-Tuning
Bao Li, Xiaomei Zhang, Miao Xu +3
Generating 3D human poses from multimodal inputs such as images or text requires models to capture both rich spatial and semantic correspondences. While pose-specific multimodal la…
RealisVSR: Detail-enhanced Diffusion for Real-World 4K Video Super-Resolution
Weisong Zhao, Jingkai Zhou, Xiangyu Zhu +4
Video Super-Resolution (VSR) has achieved significant progress through diffusion models, effectively addressing the over-smoothing issues inherent in GAN-based methods. Despite rec…
MLLM-Enhanced Face Forgery Detection: A Vision-Language Fusion Solution
Siran Peng, Zipei Wang, Li Gao +5
Reliable face forgery detection algorithms are crucial for countering the growing threat of deepfake-driven disinformation. Previous research has demonstrated the potential of Mult…
SRM-Hair: Single Image Head Mesh Reconstruction via 3D Morphable Hair
Zidu Wang, Jiankuo Zhao, Miao Xu +2
3D Morphable Models (3DMMs) have played a pivotal role as a fundamental representation or initialization for 3D avatar animation and reconstruction. However, extending 3DMMs to hai…
PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generation
Baiqin Wang, Xiangyu Zhu, Fan Shen +2
Recent advancements in audio-driven talking face generation have made great progress in lip synchronization. However, current methods often lack sufficient control over facial anim…
WMamba: Wavelet-based Mamba for Face Forgery Detection
Siran Peng, Tianshuo Zhang, Li Gao +4
The rapid evolution of deepfake generation technologies necessitates the development of robust face forgery detection algorithms. Recent studies have demonstrated that wavelet anal…
MVBoost: Boost 3D Reconstruction with Multi-View Refinement
Xiangyu Liu, Xiaomei Zhang, Zhiyuan Ma +2
Recent advancements in 3D object reconstruction have been remarkable, yet most current 3D models rely heavily on existing 3D datasets. The scarcity of diverse 3D datasets results i…
Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Data
Ivan DeAndres-Tame, Ruben Tolosana, Pietro Melzi +56
Synthetic data is gaining increasing popularity for face recognition technologies, mainly due to the privacy concerns and challenges associated with obtaining real data, including…
Revisiting Marr in Face: The Building of 2D--2.5D--3D Representations in Deep Neural Networks
Xiangyu Zhu, Chang Yu, Jiankuo Zhao +3
David Marr's seminal theory of vision proposes that the human visual system operates through a sequence of three stages, known as the 2D sketch, the 2.5D sketch, and the 3D model.…
Enhancing Instruction-Following Capability of Visual-Language Models by Reducing Image Redundancy
Te Yang, Jian Jia, Xiangyu Zhu +9
Large Language Models (LLMs) have strong instruction-following capability to interpret and execute tasks as directed by human commands. Multimodal Large Language Models (MLLMs) hav…
S2TD-Face: Reconstruct a Detailed 3D Face with Controllable Texture from a Single Sketch
Zidu Wang, Xiangyu Zhu, Jiang Yu +2
3D textured face reconstruction from sketches applicable in many scenarios such as animation, 3D avatars, artistic design, missing people search, etc., is a highly promising but un…