5 papers · 1 filter
Open-Ended CT Volume Segmentation with Weak Supervision from Language
Sanjay Subramanian, Junwei Yu, Zirui Wang +5
We introduce a method for training a text-conditioned segmentation model for CT scans, which combines voxel-level supervision with coarse but scalable slice-level supervision from…
Pose Priors from Language Models
Sanjay Subramanian, Evonne Ng, Lea Müller +3
Language is often used to describe physical interaction, yet most 3D human pose estimation methods overlook this rich source of information. We bridge this gap by leveraging large…
TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering
Chuyi Shang, Amos You, Sanjay Subramanian +2
Recently, image-based Large Multimodal Models (LMMs) have made significant progress in video question-answering (VideoQA) using a frame-wise approach by leveraging large-scale pret…
Recursive Visual Programming
Jiaxin Ge, Sanjay Subramanian, Baifeng Shi +2
Visual Programming (VP) has emerged as a powerful framework for Visual Question Answering (VQA). By generating and executing bespoke code for each question, these methods demonstra…
From Wrong To Right: A Recursive Approach Towards Vision-Language Explanation
Jiaxin Ge, Sanjay Subramanian, Trevor Darrell +1
Addressing the challenge of adapting pre-trained vision-language models for generating insightful explanations for visual reasoning tasks with limited annotations, we present ReVis…