9 papers
MapLightning: Online Vectorized HD Map Construction with 1D Map Tokens
Shen Zheng, Anurag Ghosh, Mani Ramanagopal +1
Online vectorized HD map construction is essential for scaling safe autonomous driving and requires accurate, real-time inference. Prior methods typically rely on dense bird's-eye-…
FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors
Khiem Vuong, Deva Ramanan, Srinivasa Narasimhan
Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views ar…
Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videos
Anurag Ghosh, Francesco Pittaluga, Khiem Vuong +4
Self-driving simulations typically rely on data collected in a small number of cities or on hand-authored synthetic scenarios. Dashcam videos cover a far broader range of locations…
PhyCo: Learning Controllable Physical Priors for Generative Motion
Sriram Narayanan, Ziyu Jiang, Srinivasa Narasimhan +1
Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses s…
FrameCrafter: Novel View Synthesis as Video Completion
Qi Wu, Khiem Vuong, Minsik Jeon +2
We tackle the problem of sparse novel view synthesis (NVS) using video diffusion models; given () multi-view images of a scene and their camera poses, we predict the…
RAD-LAD: Rule and Language Grounded Autonomous Driving in Real-Time
Anurag Ghosh, Srinivasa Narasimhan, Manmohan Chandraker +1
We present LAD, a real-time language--action planner with an interruptible architecture that produces a motion plan in a single forward pass (~20 Hz) or generates textual reasoning…
AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesis
Khiem Vuong, Anurag Ghosh, Deva Ramanan +2
We explore the task of geometric reconstruction of images captured from a mixture of ground and aerial views. Current state-of-the-art learning-based approaches fail to handle the…
Accenture-NVS1: A Novel View Synthesis Dataset
Thomas Sugg, Kyle O'Brien, Lekh Poudel +6
This paper introduces ACC-NVS1, a specialized dataset designed for research on Novel View Synthesis specifically for airborne and ground imagery. Data for ACC-NVS1 was collected in…
Incorporating dense metric depth into neural 3D representations for view synthesis and relighting
Arkadeep Narayan Chaudhury, Igor Vasiljevic, Sergey Zakharov +4
Synthesizing accurate geometry and photo-realistic appearance of small scenes is an active area of research with compelling use cases in gaming, virtual reality, robotic-manipulati…