488 citations · 1.6k across the 81 of their papers we have counts for
78 papers · 1 filter
SoccerNet 2023 Challenges Results
Anthony Cioppa, Silvio Giancola, Vladimir Somers +99
The SoccerNet 2023 challenges were the third annual video understanding challenges organized by the SoccerNet team. For this third edition, the challenges were composed of seven vi…
Which Tokens to Use? Investigating Token Reduction in Vision Transformers
Joakim Bruslund Haurum, Sergio Escalera, Graham W. Taylor +1
Since the introduction of the Vision Transformer (ViT), researchers have sought to make ViTs more efficient by removing redundant information in the processed tokens. While differe…
Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining
Benjia Zhou, Zhigang Chen, Albert Clapés +5
Sign Language Translation (SLT) is a challenging task due to its cross-domain nature, involving the translation of visual-gestural language to text. Many previous methods employ an…
Beyond AUROC & co. for evaluating out-of-distribution detection performance
Galadrielle Humblot-Renaux, Sergio Escalera, Thomas B. Moeslund
While there has been a growing research interest in developing out-of-distribution (OOD) detection methods, there has been comparably little discussion around how these methods sho…
REACT2023: the first Multi-modal Multiple Appropriate Facial Reaction Generation Challenge
Siyang Song, Micol Spitale, Cheng Luo +8
The Multi-modal Multiple Appropriate Facial Reaction Generation Challenge (REACT2023) is the first competition event focused on evaluating multimedia processing and machine learnin…
Wild Face Anti-Spoofing Challenge 2023: Benchmark and Results
Dong Wang, Jia Guo, Qiqi Shao +9
Face anti-spoofing (FAS) is an essential mechanism for safeguarding the integrity of automated face recognition systems. Despite substantial advancements, the generalization of exi…
Surveillance Face Presentation Attack Detection Challenge
Hao Fang, Ajian Liu, Jun Wan +3
Face Anti-spoofing (FAS) is essential to secure face recognition systems from various physical attacks. However, most of the studies lacked consideration of long-distance scenarios…
Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Images
Hugo Bertiche, Niloy J. Mitra, Kuldeep Kulkarni +5
Cinemagraphs are short looping videos created by adding subtle motions to a static image. This kind of media is popular and engaging. However, automatic generation of cinemagraphs…
Meta-Album: Multi-domain Meta-Dataset for Few-Shot Image Classification
Ihsan Ullah, Dustin Carrión-Ojeda, Sergio Escalera +7
We introduce Meta-Album, an image classification meta-dataset designed to facilitate few-shot learning, transfer learning, meta-learning, among other tasks. It includes 40 open dat…
Surveillance Face Anti-spoofing
Hao Fang, Ajian Liu, Jun Wan +5
Face Anti-spoofing (FAS) is essential to secure face recognition systems from various physical attacks. However, recent research generally focuses on short-distance applications (i…
Neural Cloth Simulation
Hugo Bertiche, Meysam Madadi, Sergio Escalera
We present a general framework for the garment animation problem through unsupervised deep learning inspired in physically based simulation. Existing trends in the literature alrea…
BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction
German Barquero, Sergio Escalera, Cristina Palmero
Stochastic human motion prediction (HMP) has generally been tackled with generative adversarial networks and variational autoencoders. Most prior works aim at predicting highly div…
SoccerNet 2022 Challenges Results
Silvio Giancola, Anthony Cioppa, Adrien Deliège +91
The SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team. In 2022, the challenges were composed of 6 vision-based tasks:…
A Non-Anatomical Graph Structure for isolated hand gesture separation in continuous gesture sequences
Razieh Rastgoo, Kourosh Kiani, Sergio Escalera
Continuous Hand Gesture Recognition (CHGR) has been extensively studied by researchers in the last few decades. Recently, one model has been presented to deal with the challenge of…
UniUD-FBK-UB-UniBZ Submission to the EPIC-Kitchens-100 Multi-Instance Retrieval Challenge 2022
Alex Falcon, Giuseppe Serra, Sergio Escalera +1
This report presents the technical details of our submission to the EPIC-Kitchens-100 Multi-Instance Retrieval Challenge 2022. To participate in the challenge, we designed an ensem…
Relevance-based Margin for Contrastively-trained Video Retrieval Models
Alex Falcon, Swathikiran Sudhakaran, Giuseppe Serra +2
Video retrieval using natural language queries has attracted increasing interest due to its relevance in real-world applications, from intelligent access in private media galleries…
Word separation in continuous sign language using isolated signs and post-processing
Razieh Rastgoo, Kourosh Kiani, Sergio Escalera
. Continuous Sign Language Recognition (CSLR) is a long challenging task in Computer Vision due to the difficulties in detecting the explicit boundaries between the words in a sign…
Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios
German Barquero, Johnny Núñez, Zhen Xu +4
Human behavior forecasting during human-human interactions is of utmost importance to provide robotic or virtual agents with social intelligence. This problem is especially challen…
Didn't see that coming: a survey on non-verbal social human behavior forecasting
German Barquero, Johnny Núñez, Sergio Escalera +4
Non-verbal social human behavior forecasting has increasingly attracted the interest of the research community in recent years. Its direct applications to human-robot interaction a…
Towards Self-Supervised Gaze Estimation
Arya Farkhondeh, Cristina Palmero, Simone Scardapane +1
Recent joint embedding-based self-supervised methods have surpassed standard supervised approaches on various image recognition tasks such as image classification. These self-super…
Gate-Shift-Fuse for Video Action Recognition
Swathikiran Sudhakaran, Sergio Escalera, Oswald Lanz
Convolutional Neural Networks are the de facto models for image recognition. However 3D CNNs, the straight forward extension of 2D CNNs for video recognition, have not achieved the…
All You Need In Sign Language Production
Razieh Rastgoo, Kourosh Kiani, Sergio Escalera +2
Sign Language is the dominant form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired…
Video Transformers: A Survey
Javier Selva, Anders S. Johansen, Sergio Escalera +3
Transformer models have shown great success handling long-range interactions, making them a promising tool for modeling video. However, they lack inductive biases and scale quadrat…
Multi-Task Classification of Sewer Pipe Defects and Properties using a Cross-Task Graph Neural Network Decoder
Joakim Bruslund Haurum, Meysam Madadi, Sergio Escalera +1
The sewerage infrastructure is one of the most important and expensive infrastructures in modern society. In order to efficiently manage the sewerage infrastructure, automated sewe…