56 citations · 257 across the 54 of their papers we have counts for
6 papers · 1 filter
Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddings
Siqi Wang, Manyuan Lu, Nikita Moshkov +2
Analyzing the morphology of cells in microscopy images can provide insights into the mechanism of compounds or the function of genes. Addressing this task requires methods that can…
Look at What I'm Doing: Self-Supervised Spatial Grounding of Narrations in Instructional Videos
Reuben Tan, Bryan A. Plummer, Kate Saenko +2
We introduce the task of spatially localizing narrated interactions in videos. Key to our approach is the ability to learn to spatially localize interactions with self-supervision…
Show, Write, and Retrieve: Entity-aware Article Generation and Retrieval
Zhongping Zhang, Yiwen Gu, Bryan A. Plummer
Article comprehension is an important challenge in natural language processing with many applications such as article generation or image-to-article retrieval. Prior work typically…
From Coarse to Fine-grained Concept based Discrimination for Phrase Detection
Maan Qraitem, Bryan A. Plummer
Phrase detection requires methods to identify if a phrase is relevant to an image and localize it, if applicable. A key challenge for training more discriminative detection models…
Effectively Leveraging Attributes for Visual Similarity
Samarth Mishra, Zhongping Zhang, Yuan Shen +3
Measuring similarity between two images often requires performing complex reasoning along different axes (e.g., color, texture, or shape). Insights into what might be important for…
Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
Andrea Burns, Deniz Arsan, Sanjna Agrawal +3
In recent years, vision-language research has shifted to study tasks which require more complex reasoning, such as interactive question answering, visual common sense reasoning, an…