6 papers · 1 filter
LUMEN: Geometry-Guided Diffusion Model for Spatially-Varying HDR Illumination Estimation
Hongze Chen, Fangyu Lin, Runze Zhang +8
Estimating scene illumination from images is challenging as lighting is inherently spatially varying, depending on geometry, occlusion, and light sources. Existing methods incorpor…
RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay
Mengfei Li, Yi Zhang, Xingtong Ge +8
Generative gameplay requires more than immediate responses to player actions.Actions should have persistent consequences, while the generated world should act according to its own…
Enhancing Autoregressive Video Generation via Representation Adversarial Distillation
Fangyu Lin, Xingtong Ge, Lunjie Zhu +8
Few-step autoregressive video generation enables efficient streaming synthesis, but errors introduced in early temporal blocks are reused as context and can propagate through subse…
Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation
Xingtong Ge, Yutong Wang, Lunjie Zhu +7
Few-step streaming audio--video generation requires both causal modeling and step distillation, yet standard training recipes face two context-related challenges. Teacher forcing p…
Real-Time Human Frontal View Synthesis from a Single Image
Fangyu Lin, Yingdong Hu, Lunjie Zhu +4
Photorealistic human novel view synthesis from a single image is crucial for democratizing immersive 3D telepresence, eliminating the need for complex multi-camera setups. However,…
Mon3tr: Monocular 3D Telepresence with Pre-built Gaussian Avatars as Amortization
Fangyu Lin, Yingdong Hu, Zhening Liu +3
Immersive telepresence aims to transform human interaction in AR/VR applications by enabling lifelike full-body holographic representations for enhanced remote collaboration. Howev…