4 papers
Long-Horizon Streaming Video Generation via Hybrid Attention with Decoupled Distillation
Ruibin Li, Tao Yang, Fangzhou Ai +4
Streaming video generation (SVG) distills a pretrained bidirectional video diffusion model into an autoregressive model equipped with sliding window attention (SWA). However, SWA i…
Many-for-Many: Unify the Training of Multiple Video and Image Generation and Manipulation Tasks
Ruibin Li, Tao Yang, Yangming Shi +4
Diffusion models have shown impressive performance in many visual generation and manipulation tasks. Many existing methods focus on training a model for a specific task, especially…
LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervision
Chunyu Li, Chao Zhang, Weikai Xu +6
End-to-end audio-conditioned latent diffusion models (LDMs) have been widely adopted for audio-driven portrait animation, demonstrating their effectiveness in generating lifelike a…
Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMs
Dabing Cheng, Haosen Zhan, Xingchen Zhao +6
The exponential growth of short-video content has ignited a surge in the necessity for efficient, automated solutions to video editing, with challenges arising from the need to und…