3 citations · 5 across the 12 of their papers we have counts for
12 papers
P2Voxel: Pyramid Pivot Voxelization for 3D Mesh Tokenization
Zhenhong Sun, Haozhe Liu, Yifu Wang +6
Triangle meshes provide explicit and accurate surface geometry, yet their irregular topology connectivity makes 3D mesh tokenization a geometric sampling problem: how to sample and…
Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation
Hanlin Chen, Jiaxin Wei, Xibin Song +5
Frame-wise action-controlled image-to-video generation is a promising paradigm for interactive world simulation, where each control signal should elicit an immediate visual respons…
INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
InSpatio Team, Donghui Shen, Guofeng Zhang +20
Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle wit…
3DXTalker: Unifying Identity, Lip Sync, Emotion, and Spatial Dynamics in Expressive 3D Talking Avatars
Zhongju Wang, Zhenhong Sun, Beier Wang +4
Audio-driven 3D talking avatar generation is increasingly important in virtual communication, digital humans, and interactive media, where avatars must preserve identity, synchroni…
StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics
Bingliang Li, Zhenhong Sun, Jiaming Bian +6
Storyboarding is a core skill in visual storytelling for film, animation, and games. However, automating this process requires a system to achieve two properties that current appro…
I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generation
Jia Li, Han Yan, Yihang Chen +6
Despite remarkable progress in video generation, maintaining long-term scene consistency upon revisiting previously explored areas remains challenging. Existing solutions rely eith…
InSpatio-WorldFM: An Open-Source Real-Time Generative Frame Model
InSpatio Team, Donghui Shen, Guofeng Zhang +16
We present InSpatio-WorldFM, an open-source real-time frame model for spatial intelligence. Unlike video-based world models that rely on sequential frame generation and incur subst…
ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy
Zhiyi Jiang, Yifu Wang, Xuelian Cheng +1
Estimating 3D geometry from monocular colonoscopy images is challenging due to non-Lambertian surfaces, moving light sources, and large textureless regions. While recent 3D geometr…
BachVid: Training-Free Video Generation with Consistent Background and Character
Han Yan, Xibin Song, Yifu Wang +3
Diffusion Transformers (DiTs) have recently driven significant progress in text-to-video (T2V) generation. However, generating multiple videos with consistent characters and backgr…
T-S2S: Training-free Triplet Tuning for Sketch to Scene Synthesis in Controllable Concept Art Generation
Zhenhong Sun, Yifu Wang, Yonhon Ng +4
2D concept art generation for 3D scenes is a crucial yet challenging task in computer graphics, as creating natural intuitive environments still demands extensive manual effort in…
Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches
Yongzhi Xu, Yonhon Ng, Yifu Wang +6
3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel d…
MAVIS: Multi-Camera Augmented Visual-Inertial SLAM using SE2(3) Based Exact IMU Pre-integration
Yifu Wang, Yonhon Ng, Inkyu Sa +4
We present a novel optimization-based Visual-Inertial SLAM system designed for multiple partially overlapped camera systems, named MAVIS. Our framework fully exploits the benefits…