1 citations · 3 across the 13 of their papers we have counts for
14 papers
Bridging Your Imagination with Audio-Video Generation via a Unified Director
Jiaxu Zhang, Tianshu Hu, Yuan Zhang +4
Existing AI-driven video creation systems typically treat script drafting and key-shot design as two disjoint tasks: the former relies on large language models, while the latter de…
Plan-X: Instruct Video Generation via Semantic Planning
Lun Huang, You Xie, Hongyi Xu +7
Diffusion Transformers have demonstrated remarkable capabilities in visual synthesis, yet they often struggle with high-level semantic reasoning and long-horizon planning. This lim…
X-Streamer: Unified Human World Modeling with Audiovisual Interaction
You Xie, Tianpei Gu, Zenan Li +7
We introduce X-Streamer, an end-to-end multimodal human world modeling framework for building digital human agents capable of infinite interactions across text, speech, and video w…
Lynx: Towards High-Fidelity Personalized Video Generation
Shen Sang, Tiancheng Zhi, Tianpei Gu +2
We present Lynx, a high-fidelity model for personalized video synthesis from a single input image. Built on an open-source Diffusion Transformer (DiT) foundation model, Lynx introd…
X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latents
Guoxian Song, Hongyi Xu, Xiaochen Zhao +5
We present X-UniMotion, a unified and expressive implicit latent representation for whole-body human motion, encompassing facial expressions, body poses, and hand gestures. Unlike…
X-Actor: Emotional and Expressive Long-Range Portrait Acting from Audio
Chenxu Zhang, Zenan Li, Hongyi Xu +8
We present X-Actor, a novel audio-driven portrait animation framework that generates lifelike, emotionally expressive talking head videos from a single reference image and an input…
X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attention
Xiaochen Zhao, Hongyi Xu, Guoxian Song +6
We propose X-NeMo, a novel zero-shot diffusion-based portrait animation pipeline that animates a static portrait using facial movements from a driving video of a different individu…
MotionGPT3: Human Motion as a Second Modality
Bingfan Zhu, Biao Jiang, Sunyi Wang +5
With the rapid progress of large language models (LLMs), multimodal frameworks that unify understanding and generation have become promising, yet they face increasing complexity as…
X-Dancer: Expressive Music to Human Dance Video Generation
Zeyuan Chen, Hongyi Xu, Guoxian Song +6
We present X-Dancer, a novel zero-shot music-driven image animation pipeline that creates diverse and long-range lifelike human dance videos from a single static image. As its core…
X-Dyna: Expressive Dynamic Human Image Animation
Di Chang, Hongyi Xu, You Xie +12
We introduce X-Dyna, a novel zero-shot, diffusion-based pipeline for animating a single human image using facial expressions and body movements derived from a driving video, that g…
High Quality Human Image Animation using Regional Supervision and Motion Blur Condition
Zhongcong Xu, Chaoyue Song, Guoxian Song +8
Recent advances in video diffusion models have enabled realistic and controllable human image animation with temporal coherence. Although generating reasonable results, existing me…
X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attention
You Xie, Hongyi Xu, Guoxian Song +3
We propose X-Portrait, an innovative conditional diffusion model tailored for generating expressive and temporally coherent portrait animation. Specifically, given a single portrai…
DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation
Chenxu Zhang, Chao Wang, Jianfeng Zhang +7
The generation of emotional talking faces from a single portrait image remains a significant challenge. The simultaneous achievement of expressive emotional talking and accurate li…
DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesis
Yuming Gu, You Xie, Hongyi Xu +5
We present DiffPortrait3D, a conditional diffusion model that is capable of synthesizing 3D-consistent photo-realistic novel views from as few as a single in-the-wild portrait. Spe…