5 papers
AnyAct: Towards Human Reenactment of Character Motion From Video
Liuhan Chen, Lei Zhong, Jiawei Wang +6
We study the problem of directly deriving an initial human reenactment from a monocular video of a non-human character. Our goal is not to reconstruct the source character itself b…
Seeking Physics in Diffusion Noise
Chujun Tang, Lei Zhong, Fangqiang Ding
Do video diffusion models encode signals predictive of physical plausibility? We probe intermediate denoising representations of pretrained Diffusion Transformers (DiTs) and find t…
DancingBox: A Lightweight MoCap System for Character Animation from Physical Proxies
Haocheng Yuan, Adrien Bousseau, Hao Pan +2
Creating compelling 3D character animations typically requires either expert use of professional software or expensive motion capture systems operated by skilled actors. We present…
Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation
Lei Zhong, Chuan Guo, Yiming Xie +2
Storyboarding is widely used for creating 3D animations. Animators use the 2D sketches in storyboards as references to craft the desired 3D animations through a trial-and-error pro…
MulSMo: Multimodal Stylized Motion Generation by Bidirectional Control Flow
Zhe Li, Yisheng He, Lei Zhong +6
Generating motion sequences conforming to a target style while adhering to the given content prompts requires accommodating both the content and style. In existing methods, the inf…