6 papers
Livatar-1: Real-Time Talking Heads Generation with Tailored Flow Matching
Haiyang Liu, Xiaolin Hong, Xuancheng Yang +5
We present Livatar, a real-time audio-driven talking heads videos generation framework. Existing baselines suffer from limited lip-sync accuracy and long-term pose drift. We addres…
MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesis
Shitong Shao, Hongwei Yi, Hanzhong Guo +5
Recently, open-source video diffusion models (VDMs), such as WanX, Magic141 and HunyuanVideo, have been scaled to over 10 billion parameters. These large-scale VDMs have demonstrat…
MagicInfinite: Generating Infinite Talking Videos with Your Words and Voice
Hongwei Yi, Tian Ye, Shitong Shao +10
We present MagicInfinite, a novel diffusion Transformer (DiT) framework that overcomes traditional portrait animation limitations, delivering high-fidelity results across diverse c…
Magic 1-For-1: Generating One Minute Video Clips within One Minute
Hongwei Yi, Shitong Shao, Tian Ye +7
In this technical report, we present Magic 1-For-1 (Magic141), an efficient video generation model with optimized memory consumption and inference latency. The key idea is simple:…
Real-time One-Step Diffusion-based Expressive Portrait Videos Generation
Hanzhong Guo, Hongwei Yi, Daquan Zhou +3
Latent diffusion models have made great strides in generating expressive portrait videos with accurate lip-sync and natural motion from a single reference image and audio input. Ho…
Phased Consistency Models
Fu-Yun Wang, Zhaoyang Huang, Alexander William Bergman +9
Consistency Models (CMs) have made significant progress in accelerating the generation of diffusion models. However, their application to high-resolution, text-conditioned image ge…