221 citations · 236 across the 6 of their papers we have counts for
7 papers
The SA-FARI Dataset: Segment Anything in Footage of Animals for Recognition and Identification
Dante Francisco Wasmuht, Otto Brookes, Maximillian Schall +21
Automated video analysis is critical for wildlife conservation. A foundational task in this domain is multi-animal tracking (MAT), which underpins applications such as individual r…
SAM 3: Segment Anything with Concepts
Nicolas Carion, Laura Gustafson, Yuan-Ting Hu +35
We present Segment Anything Model (SAM) 3, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which we define as either short…
It's Time for Artistic Correspondence in Music and Video
Didac Suris, Carl Vondrick, Bryan Russell +1
We present an approach for recommending a music track for a given video, and vice versa, based on both their temporal alignment and their correspondence at an artistic level. We pr…
Revealing Occlusions with 4D Neural Fields
Basile Van Hoorick, Purva Tendulkar, Didac Suris +3
For computer vision systems to operate in dynamic situations, they need to be able to represent and reason about object permanence. We introduce a framework for learning to estimat…
Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
David Harwath, Adrià Recasens, Dídac Surís +3
In this paper, we explore neural network models that learn to associate segments of spoken audio captions with the semantically relevant portions of natural images that they refer…
Cross-modal Embeddings for Video and Audio Retrieval
Didac Surís, Amanda Duarte, Amaia Salvador +2
The increasing amount of online videos brings several opportunities for training self-supervised neural networks. The creation of large scale datasets of videos such as the YouTube…
Overcoming catastrophic forgetting with hard attention to the task
Joan Serrà, Dídac Surís, Marius Miron +1
Catastrophic forgetting occurs when a neural network loses the information learned in a previous task after training on subsequent tasks. This problem remains a hurdle for artifici…