331 citations · 399 across the 9 of their papers we have counts for
9 papers
Personalizing Retrieval using Joint Embeddings or "the Return of Fluffy"
Bruno Korbar, Andrew Zisserman
The goal of this paper is to be able to retrieve images using a compound query that combines object instance information from an image, with a natural text description of what that…
Look, Listen and Recognise: Character-Aware Audio-Visual Subtitling
Bruno Korbar, Jaesung Huh, Andrew Zisserman
The goal of this paper is automatic character-aware subtitle generation. Given a video and a minimal amount of metadata, we propose an audio-visual method that generates a full tra…
Text-Conditioned Resampler For Long Form Video Understanding
Bruno Korbar, Yongqin Xian, Alessio Tonioni +2
In this paper we present a text-conditioned video resampler (TCR) module that uses a pre-trained and frozen visual encoder and large language model (LLM) to process long video sequ…
End-to-end Tracking with a Multi-query Transformer
Bruno Korbar, Andrew Zisserman
Multiple-object tracking (MOT) is a challenging task that requires simultaneous reasoning about location, appearance, and identity of the objects in the scene over time. Our aim in…
Generalized Few-Shot Video Classification with Video Retrieval and Feature Generation
Yongqin Xian, Bruno Korbar, Matthijs Douze +3
Few-shot learning aims to recognize novel classes from a few examples. Although significant progress has been made in the image domain, few-shot video classification is relatively…
Video Understanding as Machine Translation
Bruno Korbar, Fabio Petroni, Rohit Girdhar +1
With the advent of large-scale multimodal video datasets, especially sequences with audio or transcribed speech, there has been a growing interest in self-supervised learning of vi…
SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition
Bruno Korbar, Du Tran, Lorenzo Torresani
While many action recognition datasets consist of collections of brief, trimmed videos each containing a relevant action, videos in the real-world (e.g., on YouTube) exhibit very d…
Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization
Bruno Korbar, Du Tran, Lorenzo Torresani
There is a natural correlation between the visual and auditive elements of a video. In this work we leverage this connection to learn general and effective models for both audio an…
Deep-Learning for Classification of Colorectal Polyps on Whole-Slide Images
Bruno Korbar, Andrea M. Olofson, Allen P. Miraflor +5
Histopathological characterization of colorectal polyps is an important principle for determining the risk of colorectal cancer and future rates of surveillance for patients. This…