8 papers
SocialCoAct: Enabling and Benchmarking Egocentric Social Co-Action for VLM-Based Humanoid Robots
Jiancong Ma, Kun Li, Jin Jiang +1
Enabling humanoid robots to participate effectively in social interactions is important for their integration into human-centered environments. Existing methods, however, typically…
Talk, Render, Act: Integrating Social Gesture and Digital Face with Synchronized Speech for Conversational Humanoid Robot
Jin Jiang, Kun Li, Jiancong Ma +1
Expressive humanoid interaction requires speech, facial animation, and body gestures to form a coherent response. However, many full-body humanoid robots produce speech and gesture…
Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editing
Yanan Wang, Shengcai Liao, Guangyi Liu +1
Reference-guided diffusion editors struggle to faithfully reproduce user-provided references. We identify a potential bottleneck in diffusion editors: many methods provide limited…
FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration
Jin Jiang, Jia Wang, Panwen Hu +2
Video face restoration (VFR) aims to recover high-quality and temporally consistent facial details from severely degraded video sequences; however, existing methods still struggle…
DirectSwap: Paired, Mask-Free Video Head Swapping with Full-Reference Evaluation
Yanan Wang, Shengcai Liao, Panwen Hu +4
Head swapping replaces an entire head while preserving pose, expression, body motion, and scene. Progress is limited by the lack of cross-identity paired videos: real footage canno…
StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration
Panwen Hu, Jin Jiang, Jianqi Chen +4
The advent of AI-Generated Content (AIGC) has spurred research into automated video generation to streamline conventional processes. However, automating storytelling video producti…
Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models
Sanoojan Baliah, Qinliang Lin, Shengcai Liao +2
Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color…
HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidance
Guian Fang, Wenbiao Yan, Yuanfan Guo +5
Text-to-image diffusion models have significantly advanced in conditional image generation. However, these models usually struggle with accurately rendering images featuring humans…