7 papers
OmniHands: Towards Robust 4D Hand Mesh Recovery via A Versatile Transformer
Dixuan Lin, Yuxiang Zhang, Mengcheng Li +5
In this paper, we introduce OmniHands, a universal approach to recovering interactive hand meshes and their relative movement from monocular or multi-view inputs. Our approach addr…
SpeechAct: Towards Generating Whole-body Motion from Speech
Jinsong Zhang, Minjie Zhu, Yuxiang Zhang +2
This paper addresses the problem of generating whole-body motion from speech. Despite great successes, prior methods still struggle to produce reasonable and diverse whole-body mot…
InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions
Ronghui Li, Youliang Zhang, Yachao Zhang +6
Humans perform a variety of interactive motions, among which duet dance is one of the most challenging interactions. However, in terms of human motion generative models, existing w…
Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patterns
Ronghui Li, Hongwen Zhang, Yachao Zhang +6
We propose Lodge++, a choreography framework to generate high-quality, ultra-long, and vivid dances given the music and desired genre. To handle the challenges in computational eff…
ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusion
Jiajun Zhang, Yuxiang Zhang, Liang An +4
Dynamic and dexterous manipulation of objects presents a complex challenge, requiring the synchronization of hand motions with the trajectories of objects to achieve seamless and p…
HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models
Mengcheng Li, Hongwen Zhang, Yuxiang Zhang +3
Recent years have witnessed a trend of the deep integration of the generation and reconstruction paradigms. In this paper, we extend the ability of controllable generative models f…