283 citations · 470 across the 84 of their papers we have counts for
12 papers · 1 filter
Refining Action Boundaries for One-stage Detection
Hanyuan Wang, Majid Mirmehdi, Dima Damen +1
Current one-stage action detection methods, which simultaneously predict action boundaries and the corresponding class, do not estimate or use a measure of confidence in their boun…
ConTra: (Con)text (Tra)nsformer for Cross-Modal Video Retrieval
Adriano Fragomeni, Michael Wray, Dima Damen
In this paper, we re-examine the task of cross-modal clip-sentence retrieval, where the clip is part of a longer untrimmed video. When the clip is short or visually ambiguous, know…
Play It Back: Iterative Attention for Audio Recognition
Alexandros Stergiou, Dima Damen
A key function of auditory cognition is the association of characteristic sounds with their corresponding semantics over time. Humans attempting to discriminate between fine-graine…
EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relations
Ahmad Darkhalil, Dandan Shan, Bin Zhu +6
We introduce VISOR, a new dataset of pixel annotations and a benchmark suite for segmenting hands and active objects in egocentric video. VISOR annotates videos from EPIC-KITCHENS,…
Egocentric Video-Language Pretraining @ Ego4D Challenge 2022
Kevin Qinghong Lin, Alex Jinpeng Wang, Mattia Soldan +13
In this report, we propose a video-language pretraining (VLP) based solution \cite{kevin2022egovlp} for four Ego4D challenge tasks, including Natural Language Query (NLQ), Moment Q…
Inertial Hallucinations -- When Wearable Inertial Devices Start Seeing Things
Alessandro Masullo, Toby Perrett, Tilo Burghardt +3
We propose a novel approach to multimodal sensor fusion for Ambient Assisted Living (AAL) which takes advantage of learning using privileged information (LUPI). We address two majo…
An Evaluation of OCR on Egocentric Data
Valentin Popescu, Dima Damen, Toby Perrett
In this paper, we evaluate state-of-the-art OCR methods on Egocentric data. We annotate text in EPIC-KITCHENS images, and demonstrate that existing OCR methods struggle with rotate…
Egocentric Video-Language Pretraining
Kevin Qinghong Lin, Alex Jinpeng Wang, Mattia Soldan +13
Video-Language Pretraining (VLP), which aims to learn transferable representation to advance a wide range of video-text downstream tasks, has recently received increasing attention…
Dual-Domain Image Synthesis using Segmentation-Guided GAN
Dena Bazazian, Andrew Calway, Dima Damen
We introduce a segmentation-guided approach to synthesise images that integrate features from two distinct domains. Images synthesised by our dual-domain model belong to one domain…
The Wisdom of Crowds: Temporal Progressive Attention for Early Action Prediction
Alexandros Stergiou, Dima Damen
Early action prediction deals with inferring the ongoing action from partially-observed videos, typically at the outset of the video. We propose a bottleneck-based attention model…
Hand-Object Interaction Reasoning
Jian Ma, Dima Damen
This paper proposes an interaction reasoning network for modelling spatio-temporal relationships between hands and objects in video. The proposed interaction unit utilises a Transf…
TVNet: Temporal Voting Network for Action Localization
Hanyuan Wang, Dima Damen, Majid Mirmehdi +1
We propose a Temporal Voting Network (TVNet) for action localization in untrimmed videos. This incorporates a novel Voting Evidence Module to locate temporal boundaries, more accur…