7 papers
Not All Birds Look The Same: Identity-Preserving Generation For Birds
Aaron Sun, Oindrila Saha, Subhransu Maji
Since the advent of controllable image generation, increasingly rich modes of control have enabled greater customization and accessibility for everyday users. Zero-shot, identity-p…
RealBirdID: Benchmarking Bird Species Identification in the Era of MLLMs
Logan Lawrence, Mustafa Chasmai, Rangel Daroya +8
Fine-grained bird species identification in the wild is frequently unanswerable from a single image: key cues may be non-visual (e.g. vocalization), or obscured due to occlusion, c…
3D Space as a Scratchpad for Editable Text-to-Image Generation
Oindrila Saha, Vojtech Krs, Radomir Mech +3
Recent progress in large language models (LLMs) has shown that reasoning improves when intermediate thoughts are externalized into explicit workspaces, such as chain-of-thought tra…
You May Speak Freely: Improving the Fine-Grained Visual Recognition Capabilities of Multimodal Large Language Models with Answer Extraction
Logan Lawrence, Oindrila Saha, Megan Wei +3
Despite the renewed interest in zero-shot visual classification due to the rise of Multimodal Large Language Models (MLLMs), the problem of evaluating free-form responses of auto-r…
VIDMP3: Video Editing by Representing Motion with Pose and Position Priors
Sandeep Mishra, Oindrila Saha, Alan C. Bovik
Motion-preserved video editing is crucial for creators, particularly in scenarios that demand flexibility in both the structure and semantics of swapped objects. Despite its potent…
Generate, Transduct, Adapt: Iterative Transduction with VLMs
Oindrila Saha, Logan Lawrence, Grant Van Horn +1
Transductive zero-shot learning with vision-language models leverages image-image similarities within the dataset to achieve better classification accuracy compared to the inductiv…