17 papers
GAINS: Gaussian-based Inverse Rendering from Sparse Multi-View Captures
Patrick Noras, Jun Myeong Choi, Didier Stricker +2
GAINS is a two‑stage inverse‑rendering system that combines Gaussian splatting with foundation‑model priors (depth, normals, segmentation, diffusion) to recover accurate geometry a…
MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos
Daniel Rho, Jun Myeong Choi, Matthew Thornton +2
Existing inverse physics methods recover physical parameters from multi-view videos, where geometric constraints across views resolve scale and 3D structure. In monocular settings,…
HarmoVid: Relightful Video Portrait Harmonization
Jun Myeong Choi, Jae Shin Yoon, Luchao Qi +2
We present a method for harmonizing the lighting of a foreground video to match a target background scene, adjusting shadows, color tone, and illumination intensity (relightful har…
Understanding Model Behavior in Monocular Polyp Sizing
Xinqi Xiong, Andrea Dunn Beltran, Junmyeong Choi +3
Accurate polyp size stratification guides surveillance decisions, with lesions larger than 5 mm typically requiring closer follow-up. However, monocular colonoscopy lacks a reliabl…
ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimation
Daniel Rho, Jun Myeong Choi, Biswadip Dey +1
Neural rendering has advanced significantly in 3D reconstruction and novel view synthesis, and integrating physics into these frameworks opens new applications such as physically a…
Stop Holding Your Breath: CT-Informed Gaussian Splatting for Dynamic Bronchoscopy
Andrea Dunn Beltran, Daniel Rho, Aarav Mehta +5
Bronchoscopic navigation relies on registering endoscopic video to a preoperative CT scan, but respiratory motion deforms the airway by 5-20 mm, creating CT-to-body divergence that…