10 papers
HiP3R: Hierarchical Pose Graphs for Long-Horizon 3D Reconstruction
Zunnan Xu, Shangchen Zhou, Yihang Luo +1
Feed-forward models accurately estimate camera motion and 3D geometry from short video windows. However, computational and memory costs prevent direct inference on sequences contai…
Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States
Kang Liao, Yihang Luo, Xiao-Ming Wu +7
We propose Puffin-World, a unified multimodal architecture that integrates physical understanding, spatial simulation, and 3D world generation and reconstruction without relying on…
Syn4D: A Multiview Synthetic 4D Dataset
Zeren Jiang, Yushi Lan, Yihang Luo +8
Dense 3D reconstruction and tracking of dynamic scenes from monocular video remains an important open challenge in computer vision. Progress in this area has been constrained by th…
VLANeXt Family: A Systematic Study of VLA Models from Core Recipes to Emerging Paradigms
Xiao-Ming Wu, Bin Fan, Kang Liao +6
Following the rise of large foundation models, Vision-Language-Action models (VLAs) emerged, leveraging strong visual and language understanding from Vision-Language Models for gen…
4RC: 4D Reconstruction via Conditional Querying Anytime and Anywhere
Yihang Luo, Shangchen Zhou, Yushi Lan +2
We present 4RC, a unified feed-forward framework for 4D reconstruction from monocular videos. Unlike existing approaches that typically decouple motion from geometry or produce lim…
OmniVGGT: Omni-Modality Driven Visual Geometry Grounded Transformer
Haosong Peng, Hao Li, Yalun Dai +8
General 3D foundation models have started to lead the trend of unifying diverse vision tasks, yet most assume RGB-only inputs and ignore readily available geometric cues (e.g., cam…
STream3R: Scalable Sequential 3D Reconstruction with Causal Transformer
Yushi Lan, Yihang Luo, Fangzhou Hong +7
We present STream3R, a novel approach to 3D reconstruction that reformulates pointmap prediction as a decoder-only Transformer problem. Existing state-of-the-art methods for multi-…
3DEnhancer: Consistent Multi-View Diffusion for 3D Enhancement
Yihang Luo, Shangchen Zhou, Yushi Lan +2
Despite advances in neural rendering, due to the scarcity of high-quality 3D datasets and the inherent limitations of multi-view diffusion models, view synthesis and 3D model gener…
Paint Bucket Colorization Using Anime Character Color Design Sheets
Yuekun Dai, Qinyue Li, Shangchen Zhou +3
Line art colorization plays a crucial role in hand-drawn animation production, where digital artists manually colorize segments using a paint bucket tool, guided by RGB values from…
Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution
Shangchen Zhou, Peiqing Yang, Jianyi Wang +2
Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, ap…