15 papers
FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry
Meng-Li Shih, Shih-Yang Su, Yuliang Zou +7
Stable and reliable 4D spatial understanding is fundamental for autonomous driving systems. While feedforward reconstruction networks can estimate camera motion and 3D structure in…
MicroZoom: Structure-Preserving Detail Synthesis at Extreme Scale
Huy Huynh, Jingwei Ma, Brian Curless +2
We introduce MicroZoom, a generative framework for gigapixel image synthesis at the microscopic scale. Given a standard photograph and a sparse set of consumer-grade microscope clo…
GarmentZoom: Generating Zoomable Images from Garment Listings
Renjie Zhao, Jingwei Ma, Huy Huynh Cao +3
Online product listings for garments often include an overview photo and a close-up to show garment details. However, each photo focuses on either field of view or garment detail,…
COMIC: Agentic Sketch Comedy Generation
Susung Hong, Brian Curless, Ira Kemelmacher-Shlizerman +1
We propose a fully automated AI system that produces short comedic videos similar to sketch shows such as Saturday Night Live. Starting from character references, the system employ…
Prior-Enhanced Gaussian Splatting for Dynamic Scene Reconstruction from Casual Video
Meng-Li Shih, Ying-Huan Chen, Yu-Lun Liu +1
We introduce a fully automatic pipeline for dynamic scene reconstruction from casually captured monocular RGB videos. Rather than designing a new scene representation, we enhance t…
UltraZoom: Generating Gigapixel Images from Regular Photos
Jingwei Ma, Vivek Jayaram, Brian Curless +2
We present UltraZoom, a system for generating gigapixel-resolution images of objects from casually captured inputs, such as handheld phone photos. Given a full-shot image (global,…
GenEscape: Hierarchical Multi-Agent Generation of Escape Room Puzzles
Mengyi Shan, Brian Curless, Ira Kemelmacher-Shlizerman +1
We challenge text-to-image models with generating escape room puzzle images that are visually appealing, logically solid, and intellectually stimulating. While base image models st…
Generating Fit Check Videos with a Handheld Camera
Bowei Chen, Brian Curless, Ira Kemelmacher-Shlizerman +1
Self-captured full-body videos are popular, but most deployments require mounted cameras, carefully-framed shots, and repeated practice. We propose a more convenient solution that…
How Animals Dance (When You're Not Looking)
Xiaojuan Wang, Aleksander Holynski, Brian Curless +2
We present a framework for generating music-synchronized, choreography aware animal dance videos. Our framework introduces choreography patterns -- structured sequences of motion b…
View2CAD: Reconstructing View-Centric CAD Models from Single RGB-D Scans
James Noeckel, Benjamin Jones, Adriana Schulz +1
Parametric CAD models, represented as Boundary Representations (B-reps), are foundational to modern design and manufacturing workflows, offering the precision and topological break…
MusicInfuser: Making Video Diffusion Listen and Dance
Susung Hong, Ira Kemelmacher-Shlizerman, Brian Curless +1
We introduce MusicInfuser, an approach that aligns pre-trained text-to-video diffusion models to generate high-quality dance videos synchronized with specified music tracks. Rather…
VidPanos: Generative Panoramic Videos from Casual Panning Videos
Jingwei Ma, Erika Lu, Roni Paiss +6
Panoramic image stitching provides a unified, wide-angle view of a scene that extends beyond the camera's field of view. Stitching frames of a panning video into a panoramic photog…
Inverse Painting: Reconstructing The Painting Process
Bowei Chen, Yifan Wang, Brian Curless +2
Given an input painting, we reconstruct a time-lapse video of how it may have been painted. We formulate this as an autoregressive image generation problem, in which an initially b…
Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation
Xiaojuan Wang, Boyang Zhou, Brian Curless +3
We present a method for generating video sequences with coherent motion between a pair of input key frames. We adapt a pretrained large-scale image-to-video diffusion model (origin…
ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models
Meng-Li Shih, Wei-Chiu Ma, Lorenzo Boyice +4
We propose ExtraNeRF, a novel method for extrapolating the range of views handled by a Neural Radiance Field (NeRF). Our main idea is to leverage NeRFs to model scene-specific, fin…