10 papers
Wan-Animate-2: Pushing the Application Boundaries of Character Animation
Guangyuan Wang, Li Hu, Dechao Meng +11
Character image animation remains a foundational yet challenging task in computer vision. Existing approaches can be broadly categorized into three paradigms: methods based on expl…
Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation
Mingyang Huang, Peng Zhang, Li Hu +5
Generating long-duration, high-definition, and rhythmically synchronized dance videos directly from music remains a significant challenge, primarily due to the temporal constraints…
MultiAnimate: A Unified Framework for Controllable Multi-Character Animation
Zhongyi Zhang, Guangyuan Wang, Li Hu +6
Recent advances in generative models and technological innovations have significantly addressed the fundamental challenges of character image animation. However, existing approache…
WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction
Li Hu, Guangyuan Wang, Peng Zhang +1
We present WanToFight, a generative game engine that simulates real-time, two-player The King of Fighters '97 (KOF~'97) gameplay from keyboard input. Prior generative game engines…
UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
Tianxing Xu, Zixuan Wang, Guangyuan Wang +5
World models based on video generation demonstrate remarkable potential for simulating interactive environments yet suffer from persistent difficulties in two key areas: maintainin…
Wan-Animate: Unified Character Animation and Replacement with Holistic Replication
Gang Cheng, Xin Gao, Li Hu +23
We introduce Wan-Animate, a unified framework for character animation and replacement. Given a character image and a reference video, Wan-Animate can animate the character by preci…
Wan-S2V: Audio-Driven Cinematic Video Generation
Xin Gao, Li Hu, Siqi Hu +20
Current state-of-the-art (SOTA) methods for audio-driven character animation demonstrate promising performance for scenarios primarily involving speech and singing. However, they o…
MirrorMe: Towards Realtime and High Fidelity Audio-Driven Halfbody Animation
Dechao Meng, Steven Xiao, Xindi Zhang +5
Audio-driven portrait animation, which synthesizes realistic videos from reference images using audio signals, faces significant challenges in real-time generation of high-fidelity…
Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance
Li Hu, Guangyuan Wang, Zhen Shen +6
Recent character image animation methods based on diffusion models, such as Animate Anyone, have made significant progress in generating consistent and generalizable character anim…
High-Resolution Volumetric Reconstruction for Clothed Humans
Sicong Tang, Guangyuan Wang, Qing Ran +3
We present a novel method for reconstructing clothed humans from a sparse set of, e.g., 1 to 6 RGB images. Despite impressive results from recent works employing deep implicit repr…