5 papers
Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories
Wonbong Jang, Shikun Liu, Soubhik Sanyal +6
Recovering camera parameters from images and rendering scenes from novel viewpoints have been treated as separate tasks in computer vision and graphics. This separation breaks down…
Scaling Sequence-to-Sequence Generative Neural Rendering
Shikun Liu, Kam Woh Ng, Wonbong Jang +9
We present Kaleido, a family of generative models designed for photorealistic, unified object- and scene-level neural rendering. Kaleido operates on the principle that 3D can be re…
FlowFixer: Towards Detail-Preserving Subject-Driven Generation
Jinyoung Jun, Won-Dong Jang, Wenbin Ouyang +2
We present FlowFixer, a refinement framework for subject-driven generation (SDG) that restores fine details lost during generation caused by changes in scale and perspective of a s…
DT-NVS: Diffusion Transformers for Novel View Synthesis
Wonbong Jang, Jonathan Tremblay, Lourdes Agapito
Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension…
Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors
Wonbong Jang, Philippe Weinzaepfel, Vincent Leroy +2
We present Pow3r, a novel large 3D vision regression model that is highly versatile in the input modalities it accepts. Unlike previous feed-forward models that lack any mechanism…