8 papers
Magpie: Real-Time World Renderer for Interactive Games
Xiaoyu Zhan, Xinyu Wang, Xiaohong Zhang +6
Modern game development relies heavily on conventional graphics pipelines. High-quality visual content requires modeling, material authoring, animation, lighting, effects, and runt…
MoGeFlow: Flowing Through Motion Codebook Geometry for Text-to-Motion Generation
Pengcheng Fang, Tengjiao Sun, Xiaoyu Zhan +2
Vector-quantized tokenizers have become the dominant interface for text-to-motion generation, and the priors built on them treat motion codes as unordered categorical labels. We sh…
KV-Control: Parameter-Efficient K/V Injection for Trajectory-Controlled Text-to-Motion
Tengjiao Sun, Pengcheng Fang, Xiaoyu Zhan +4
Text-conditioned 3D human motion models now synthesize plausible motions from prompts, but practical animation and embodied-agent workflows rarely stop at text: a character may nee…
SCAMP: Sparse-anchor Control is One Small Projection
Pengcheng Fang, Tengjiao Sun, Dongjie Fu +4
Authoring with a text-to-motion generator needs sparse anchors: chosen joints, at chosen frames, at given positions. Meeting them currently costs a conditioning branch trained for…
UMo: Unified Sparse Motion Modeling for Real-Time Co-Speech Avatars
Xiaoyu Zhan, Xinyu Fu, Chenghao Yang +9
Speech-driven gestures and facial animations are fundamental to expressive digital avatars in games, virtual production, and interactive media. However, existing methods are either…
CHASM: Cross-frequency Harmonized Axis-Separable Mixing for Spectral Token Operators
Pengcheng Fang, Hongli Chen, Yuxia Chen +3
Spectral token mixers based on Fourier transforms provide an efficient way to model global interactions in visual feature maps. Existing designs often either apply filter-wise spec…
MotionDuet: Dual-Conditioned 3D Human Motion Generation with Video-Regularized Text Learning
Yi-Yang Zhang, Tengjiao Sun, Pengcheng Fang +4
3D Human motion generation is pivotal across film, animation, gaming, and embodied intelligence. Traditional 3D motion synthesis relies on costly motion capture, while recent work…
MOGO: Residual Quantized Hierarchical Causal Transformer for High-Quality and Real-Time 3D Human Motion Generation
Dongjie Fu, Tengjiao Sun, Pengcheng Fang +2
Recent advances in transformer-based text-to-motion generation have led to impressive progress in synthesizing high-quality human motion. Nevertheless, jointly achieving high fidel…