7 papers
EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video
Yuan Zeng, Yujia Shi, Tiao Tan +6
Estimating full-hand grasp pressure from egocentric video is critical for immersive VR and robotic manipulation, yet dense tactile sensing often relies on intrusive hardware. Exist…
Beyond Skeletons: Learning Animation Directly from Driving Videos with Same2X Training Strategy
Yuan Zeng, Yujia Shi, Yuhao Yang +4
Human image animation aims to generate a video from a static reference image, guided by pose information extracted from a driving video. Existing approaches often rely on pose esti…
FreeAnimate: Training-Free Human Image Animation with Preview-Guided Denoising
Yuan Zeng, Yujia Shi, Zongqing Lu +1
Human Image Animation has seen significant advancements, primarily driven by diffusion models. However, existing methods typically demand substantial training data and resources to…
EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation
Yuan Zeng, Zilue Gao, Yujia Shi +3
Estimating hand-surface contact pressure from an egocentric view is crucial for AR/VR devices, robotic imitation, and ergonomic analysis. Existing methods often discretize pressure…
SmoothSync: Dual-Stream Diffusion Transformers for Jitter-Robust Beat-Synchronized Gesture Generation from Quantized Audio
Yujiao Jiang, Qingmin Liao, Zongqing Lu
Co-speech gesture generation is a critical area of research aimed at synthesizing speech-synchronized human-like gestures. Existing methods often suffer from issues such as rhythmi…
Elucidating the solution space of extended reverse-time SDE for diffusion models
Qinpeng Cui, Xinyi Zhang, Qiqi Bao +1
Sampling from Diffusion Models can alternatively be seen as solving differential equations, where there is a challenge in balancing speed and image visual quality. ODE-based sample…