4 papers
Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation
Chunyu Li, Jiaye Li, Ruiqiao Mei +4
Real-time text-driven joint audio-video avatar generation requires jointly synthesizing portrait video and speech with high fidelity and precise synchronization, yet existing audio…
Head-wise Adaptive Rotary Positional Encoding for Fine-Grained Image Generation
Jiaye Li, Baoyou Chen, Hui Li +3
Transformers rely on explicit positional encoding to model structure in data. While Rotary Position Embedding (RoPE) excels in 1D domains, its application to image generation revea…
Pyramidal Patchification Flow for Visual Generation
Hui Li, Baoyou Chen, Liwei Zhang +3
Diffusion transformers (DiTs) adopt Patchify, mapping patch representations to token representations through linear projections, to adjust the number of tokens input to DiT blocks…
OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation
Hui Li, Mingwang Xu, Yun Zhan +8
Recent advancements in visual generation technologies have markedly increased the scale and availability of video datasets, which are crucial for training effective video generatio…