5 papers
AnyAct: Towards Human Reenactment of Character Motion From Video
Liuhan Chen, Lei Zhong, Jiawei Wang +5
We study the problem of directly deriving an initial human reenactment from a monocular video of a non-human character. Our goal is not to reconstruct the source character itself b…
DancingBox: A Lightweight MoCap System for Character Animation from Physical Proxies
Haocheng Yuan, Adrien Bousseau, Hao Pan +2
Creating compelling 3D character animations typically requires either expert use of professional software or expensive motion capture systems operated by skilled actors. We present…
Seeking Physics in Diffusion Noise
Chujun Tang, Lei Zhong, Fangqiang Ding
Do video diffusion models encode signals predictive of physical plausibility? We probe intermediate denoising representations of pretrained Diffusion Transformers (DiTs) and find t…
Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation
Lei Zhong, Chuan Guo, Yiming Xie +2
Storyboarding is widely used for creating 3D animations. Animators use the 2D sketches in storyboards as references to craft the desired 3D animations through a trial-and-error pro…
SMooDi: Stylized Motion Diffusion Model
Lei Zhong, Yiming Xie, Varun Jampani +2
We introduce a novel Stylized Motion Diffusion model, dubbed SMooDi, to generate stylized motion driven by content texts and style motion sequences. Unlike existing methods that ei…