4 papers
Neural Voxel Dynamics: Learning Implicit 3D Physics via Volumetric Feature Advection
Zican Wang, Niloy Mitra
We present a self-supervised framework for learning implicit 3D physical dynamics directly from video-derived supervisory signals. While current generative video models achieve hig…
LooseControlVideo: Directorial Video Control using Spatial Blocking
Shariq Farooq Bhat, Niloy J. Mitra, Kalyan Sunkavalli
Precise 3D spatial orchestration in text-to-video generation remains a significant challenge, particularly for multi-object scenes where semantic layout and temporal dynamics are o…
Blended Chart Surfaces: A Seamless Explicit Representation for Smooth Surface Fitting
Romy Williamson, Niloy Mitra
A surface representation suitable for geometry processing should be compact and explicit, provide global smoothness guarantees, support a wide range of surface topologies, and offe…
WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling
Shaoheng Fang, Hanwen Jiang, Yunpeng Bai +2
Recent video generators achieve striking photorealism, yet remain fundamentally inconsistent in 3D. We present WorldReel, a 4D video generator that is natively spatio-temporally co…