9 papers
World2Motion: Turning Video World Models into 3D Human Motion Generators
Fangyuan Tu, Tu Fangyuan, Xiangyue Zhang +9
We present World2Motion, a framework that generates scene-aware 3D human motion and corresponding video from a single image and a text prompt. While existing 3D motion generators l…
Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras
Qiaoge Li, Yifan Zhan, Haijun Yang +3
Real-world capture is heterogeneous: perspective, fisheye, and panoramic images can coexist within a single reconstruction task, yet most feed-forward 3D reconstruction…
Triangular Resampling for Long-Horizon Motion Generation
Kunhang Li, Yiyi Cai, Xiangyue Zhang +5
We introduce Triangular Resampling (TR), a post-training method for mitigating long-horizon error accumulation in motion diffusion models. Built on FloodDiffusion's triangular deno…
FloodDiffusion 2: Efficient and Path Controllable Streaming Motion Generation
Yiyi Cai, Yuhan Wu, Kunhang Li +6
We present FloodDiffusion 2 (FD2), an efficient and controllable framework that builds upon FloodDiffusion (FD1), a state-of-the-art streaming motion generation model. While FD1 pr…
Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech
Dong Yang, Yiyi Cai, Haoyu Zhang +2
Metric-induced discrete flow matching (MI-DFM) exploits token-latent geometry for discrete generation, but its practical use is limited by two issues: heuristic schedulers requirin…
PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers
Xiangyue Zhang, Yiyi Cai, Kunhang Li +6
We propose PersonaGesture, a diffusion-based pipeline for single-reference co-speech gesture personalization of unseen speakers. Given target speech and one motion clip from a new…
Towards Interactive Intelligence for Digital Humans
Yiyi Cai, Xuangeng Chu, Xiwei Gao +16
We introduce Interactive Intelligence, a novel paradigm of digital human that is capable of personality-aligned expression, adaptive interaction, and self-evolution. To realize thi…
FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generation
Yiyi Cai, Yuhan Wu, Kunhang Li +3
We present FloodDiffusion, a new framework for text-driven, streaming human motion generation. Given time-varying text prompts, FloodDiffusion generates text-aligned, seamless moti…
Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis
Dong Yang, Yiyi Cai, Yuki Saito +2
We propose Shallow Flow Matching (SFM), a novel mechanism that enhances flow matching (FM)-based text-to-speech (TTS) models within a coarse-to-fine generation paradigm. Unlike con…