4 papers · 1 filter
When Trackers Fail: VLM-Guided Verification and Recovery for Robust Video Object Segmentation
Valay Bundele, Susmit Agrawal, Mehran Hosseinzadeh +2
Recent trackers built on foundation models such as the Segment Anything Model (SAM) achieve strong performance by propagating object masks through memory. However, this strength is…
FrameDiffuser: G-Buffer-Conditioned Diffusion for Neural Forward Frame Rendering
Ole Beisswenger, Jan-Niklas Dihlmann, Hendrik P. A. Lensch
Neural rendering for interactive applications requires translating geometric and material properties (G-buffer) to photorealistic images with realistic lighting on a frame-by-frame…
ReMeDI: Refined Memory for Disambiguation of Identities with SAM3 in Surgical Segmentation
Valay Bundele, Mehran Hosseinzadeh, Hendrik P. A. Lensch
Accurate surgical instrument segmentation in endoscopy is crucial for computer-assisted interventions, yet remains challenging due to frequent occlusions, rapid motion, and long-te…
You Are Your Best Teacher: Semi-Supervised Surgical Point Tracking with Cycle-Consistent Self-Distillation
Valay Bundele, Mehran Hosseinzadeh, Hendrik Lensch
Synthetic datasets have enabled significant progress in point tracking by providing large-scale, densely annotated supervision. However, deploying these models in real-world domain…