8 papers
MoRAE: Flow-Friendly Self-Supervised Latents for Text-to-Motion Generation
Yifei Zhu, Mingyi Shi, Yangyang Cai +3
Text-to-motion generation must produce motions that are semantically correct, temporally coherent, and physically plausible. A natural approach is to first project motion data into…
Prior-First, Condition-Second: Scalable and Controllable Hand Motion Completion
Mingyi Shi, Xuelin Chen, Taku Komura
Synthesizing hand motion that matches the full body motion and the semantic labels is a difficult task due to their high degrees of freedom and the lack of semantic labels. To cope…
LPM 1.0: Video-based Character Performance Model
Ailing Zeng, Casper Yang, Chauncey Ge +22
Performance, the externalization of intent, emotion, and personality through visual, vocal, and temporal behavior, is what makes a character alive. Learning such performance from v…
OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation
Guowei Xu, Yuxuan Bian, Ailing Zeng +6
This paper introduces OmniMotion-X, a versatile multimodal framework for whole-body human motion generation, leveraging an autoregressive diffusion transformer in a unified sequenc…
InterAct: A Large-Scale Dataset of Dynamic, Expressive and Interactive Activities between Two People in Daily Scenarios
Leo Ho, Yinghao Huang, Dafei Qin +5
We address the problem of accurate capture of interactive behaviors between two people in daily scenarios. Most previous works either only consider one person or solely focus on co…
MotionPersona: Characteristics-aware Locomotion Control
Mingyi Shi, Wei Liu, Jidong Mei +4
We present MotionPersona, a novel real-time character controller that allows users to characterize a character by specifying attributes such as physical traits, mental states, and…