6 papers
RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay
Mengfei Li, Yi Zhang, Xingtong Ge +8
Generative gameplay requires more than immediate responses to player actions.Actions should have persistent consequences, while the generated world should act according to its own…
Enhancing Autoregressive Video Generation via Representation Adversarial Distillation
Fangyu Lin, Xingtong Ge, Lunjie Zhu +8
Few-step autoregressive video generation enables efficient streaming synthesis, but errors introduced in early temporal blocks are reused as context and can propagate through subse…
Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation
Xingtong Ge, Yutong Wang, Lunjie Zhu +7
Few-step streaming audio--video generation requires both causal modeling and step distillation, yet standard training recipes face two context-related challenges. Teacher forcing p…
Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
Lunjie Zhu, Xingtong Ge, Fangyu Lin +7
Joint audio-video generative models serve as foundation for immersive and interactive digital-human generation. Nevertheless, most existing models rely on bidirectional attention a…
Real-Time Human Frontal View Synthesis from a Single Image
Fangyu Lin, Yingdong Hu, Lunjie Zhu +4
Photorealistic human novel view synthesis from a single image is crucial for democratizing immersive 3D telepresence, eliminating the need for complex multi-camera setups. However,…
Mon3tr: Monocular 3D Telepresence with Pre-built Gaussian Avatars as Amortization
Fangyu Lin, Yingdong Hu, Zhening Liu +3
Immersive telepresence aims to transform human interaction in AR/VR applications by enabling lifelike full-body holographic representations for enhanced remote collaboration. Howev…