5 papers · 1 filter
CoaG: Cylinders on a Grid for Coarse 3D Layout Control in Video Generation
Zhangsihao Yang, Mengyi Shan
We ask how little geometry a person has to draw to control both where people stand and where the camera moves in a generated video. Our answer is a ground plane and one cylinder pe…
Talking Together: Synthesizing Co-Located 3D Conversations from Audio
Mengyi Shan, Shouchieh Chang, Ziqian Bai +6
We tackle the challenging task of generating complete 3D facial animations for two interacting, co-located participants from a mixed audio stream. While existing methods often prod…
AMG: Avatar Motion Guided Video Generation
Zhangsihao Yang, Mengyi Shan, Mohammad Farazi +4
Human video generation task has gained significant attention with the advancement of deep generative models. Generating realistic videos with human movements is challenging in natu…
Towards Open Domain Text-Driven Synthesis of Multi-Person Motions
Mengyi Shan, Lu Dong, Yutao Han +5
This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it…
OmniMotionGPT: Animal Motion Generation with Limited Data
Zhangsihao Yang, Mingyuan Zhou, Mengyi Shan +6
Our paper aims to generate diverse and realistic animal motion sequences from textual descriptions, without a large-scale animal text-motion dataset. While the task of text-driven…