101 citations · 277 across the 15 of their papers we have counts for
18 papers · 1 filter
ROAD-Waymo: A Large-Scale Action Awareness Dataset for Autonomous Driving
Salman Khan, Izzeddin Teeti, Reza Javanmard Alitappeh +5
Autonomous Vehicle (AV) perception systems require more than simply seeing, via e.g., object detection or scene segmentation. They need a holistic understanding of what is happenin…
Spatio-Temporal Action Detection Under Large Motion
Gurkirt Singh, Vasileios Choutas, Suman Saha +2
Current methods for spatiotemporal action tube detection often extend a bounding box proposal at a given keyframe into a 3D temporal cuboid and pool features from nearby frames. Ho…
Exploiting Instance-based Mixed Sampling via Auxiliary Source Domain Supervision for Domain-adaptive Action Detection
Yifan Lu, Gurkirt Singh, Suman Saha +1
We propose a novel domain adaptive action detection approach and a new adaptation protocol that leverages the recent advancements in image-level unsupervised domain adaptation (UDA…
The SARAS Endoscopic Surgeon Action Detection (ESAD) dataset: Challenges and methods
Vivek Singh Bawa, Gurkirt Singh, Francis KapingA +16
For an autonomous robotic system, monitoring surgeon actions and assisting the main surgeon during a procedure can be very challenging. The challenges come from the peculiar struct…
ROAD: The ROad event Awareness Dataset for Autonomous Driving
Gurkirt Singh, Stephen Akrigg, Manuele Di Maio +13
Humans drive in a holistic fashion which entails, in particular, understanding dynamic road events and their evolution. Injecting these capabilities in autonomous vehicles can thus…
Online Spatiotemporal Action Detection and Prediction via Causal Representations
Gurkirt Singh
In this thesis, we focus on video action understanding problems from an online and real-time processing point of view. We start with the conversion of the traditional offline spati…
ESAD: Endoscopic Surgeon Action Detection Dataset
Vivek Singh Bawa, Gurkirt Singh, Francis KapingA +8
In this work, we take aim towards increasing the effectiveness of surgical assistant robots. We intended to make assistant robots safer by making them aware about the actions of su…
Two-Stream AMTnet for Action Detection
Suman Saha, Gurkirt Singh, Fabio Cuzzolin
In this paper, we propose Two-Stream AMTnet, which leverages recent advances in video-based action representation[1] and incremental action tube generation[2]. Majority of the pres…
End-to-End Video Captioning
Silvio Olivastri, Gurkirt Singh, Fabio Cuzzolin
Building correspondences across different modalities, such as video and language, has recently become critical in many visual recognition applications, such as video captioning. In…
Recurrent Convolutions for Causal 3D CNNs
Gurkirt Singh, Fabio Cuzzolin
Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existin…
Predicting Action Tubes
Gurkirt Singh, Suman Saha, Fabio Cuzzolin
In this work, we present a method to predict an entire `action tube' (a set of temporally linked bounding boxes) in a trimmed video just by observing a smaller subset of it. Predic…
Action Detection from a Robot-Car Perspective
Valentina Fontana, Gurkirt Singh, Stephen Akrigg +3
We present the new Road Event and Activity Detection (READ) dataset, designed and created from an autonomous vehicle perspective to take action detection challenges to autonomous d…
Spatio-temporal Human Action Localisation and Instance Segmentation in Temporally Untrimmed Videos
Suman Saha, Gurkirt Singh, Michael Sapienza +2
Current state-of-the-art human action recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. In this work we address t…
AMTnet: Action-Micro-Tube Regression by End-to-end Trainable Deep Architecture
Suman Saha, Gurkirt Singh, Fabio Cuzzolin
Dominant approaches to action detection can only provide sub-optimal solutions to the problem, as they rely on seeking frame-level detections, to later compose them into "action tu…
Incremental Tube Construction for Human Action Detection
Harkirat Singh Behl, Michael Sapienza, Gurkirt Singh +3
Current state-of-the-art action detection systems are tailored for offline batch-processing applications. However, for online applications like human-robot interaction, current sys…
Online Real-time Multiple Spatiotemporal Action Localisation and Prediction
Gurkirt Singh, Suman Saha, Michael Sapienza +2
We present a deep-learning framework for real-time multiple spatio-temporal (S/T) action localisation, classification and early prediction. Current state-of-the-art approaches work…
Deep Learning for Detecting Multiple Space-Time Action Tubes in Videos
Suman Saha, Gurkirt Singh, Michael Sapienza +2
In this work, we propose an approach to the spatiotemporal localisation (detection) and classification of multiple concurrent actions within temporally untrimmed videos. Our framew…
Untrimmed Video Classification for Activity Detection: submission to ActivityNet Challenge
Gurkirt Singh, Fabio Cuzzolin
Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, ye…