5 papers
CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching
Shangye Song, Dong Gong, Hong Jia +2
Interactive video world models need to generate each video chunk efficiently while responding faithfully to user controls. Many systems use chunk-wise autoregressive generation wit…
Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer
Yuze Li, Dong Gong, Xiao Cao +6
Motion transfer has emerged as a promising direction for controllable video generation, yet existing methods largely focus on single-object scenarios and struggle when multiple obj…
Let Your Video Listen to Your Music!
Xinyu Zhang, Dong Gong, Zicheng Duan +2
Aligning the rhythm of visual motion in a video with a given music track is a practical need in multimedia production, yet remains an underexplored task in autonomous video editing…
Continual Learning on CLIP via Incremental Prompt Tuning with Intrinsic Textual Anchors
Haodong Lu, Xinyu Zhang, Kristen Moore +4
Continual learning (CL) enables deep networks to acquire new knowledge while avoiding catastrophic forgetting. The powerful generalization ability of pre-trained models (PTMs), suc…
Training-Free Motion-Guided Video Generation with Enhanced Temporal Consistency Using Motion Consistency Loss
Xinyu Zhang, Zicheng Duan, Dong Gong +1
In this paper, we address the challenge of generating temporally consistent videos with motion guidance. While many existing methods depend on additional control modules or inferen…