101 citations · 124 across the 11 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.SD2024
UniMuMo: Unified Text, Music and Motion Generation
Han Yang, Kun Su, Yutong Zhang +4
We introduce UniMuMo, a unified multimodal model capable of taking arbitrary text, music, and motion data as input conditions to generate outputs across all three modalities. To ad…
cs.CV2024
RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text
Jiaben Chen, Xin Yan, Yihang Chen +7
In this work, we introduce a challenging task for simultaneously generating 3D holistic body motions and singing vocals directly from textual lyrics inputs, advancing beyond existi…
cs.RO2024★ 4 cited
RoboDreamer: Learning Compositional World Models for Robot Imagination
Siyuan Zhou, Yilun Du, Jiaben Chen +3
Text-to-video models have demonstrated substantial potential in robotic decision-making, enabling the imagination of realistic plans of future actions as well as accurate environme…