87 citations · 699 across the 38 of their papers we have counts for
46 papers
Cost Savings from Automatic Quality Assessment of Generated Images
Xavier Giro-i-Nieto, Nefeli Andreou, Anqi Liang +3
Deep generative models have shown impressive progress in recent years, making it possible to produce high quality images with a simple text prompt or a reference image. However, st…
Towards Robust Image-in-Audio Deep Steganography
Jaume Ros, Margarita Geleta, Jordi Pons +1
The field of steganography has experienced a surge of interest due to the recent advancements in AI-powered techniques, particularly in the context of multimodal setups that enable…
Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22
Laia Tarrés, Gerard I. Gàllego, Xavier Giró-i-Nieto +1
This paper describes the system developed at the Universitat Politècnica de Catalunya for the Workshop on Machine Translation 2022 Sign Language Translation Task, in particular, fo…
SIRA: Relightable Avatars from a Single Image
Pol Caselles, Eduard Ramon, Jaime Garcia +3
Recovering the geometry of a human head from a single image, while factorizing the materials and illumination is a severely ill-posed problem that requires prior information to be…
Topic Detection in Continuous Sign Language Videos
Alvaro Budria, Laia Tarres, Gerard I. Gallego +3
Significant progress has been made recently on challenging tasks in automatic sign language understanding, such as sign language recognition, translation and production. However, t…
H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction
Eduard Ramon, Gil Triginer, Janna Escur +4
Recent learning approaches that implicitly represent surface geometry using coordinate-based neural representations have shown impressive results in the problem of multi-view 3D re…
Unsupervised Skill-Discovery and Skill-Learning in Minecraft
Juan José Nieto, Roger Creus, Xavier Giro-i-Nieto
Pre-training Reinforcement Learning agents in a task-agnostic manner has shown promising results. However, previous works still struggle in learning and discovering meaningful skil…
PixInWav: Residual Steganography for Hiding Pixels in Audio
Margarita Geleta, Cristina Punti, Kevin McGuinness +3
Steganography comprises the mechanics of hiding data in a host media that may be publicly available. While previous works focused on unimodal setups (e.g., hiding images in images,…
SynthRef: Generation of Synthetic Referring Expressions for Object Segmentation
Ioannis Kazakos, Carles Ventura, Miriam Bellver +2
Recent advances in deep learning have brought significant progress in visual grounding tasks such as language-guided video object segmentation. However, collecting large datasets f…
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data
Oscar Mañas, Alexandre Lacoste, Xavier Giro-i-Nieto +2
Remote sensing and automatic earth monitoring are key to solve global-scale challenges such as disaster prevention, land use monitoring, or tackling climate change. Although there…
Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses
Lucas Ventura, Amanda Duarte, Xavier Giro-i-Nieto
Recent work have addressed the generation of human poses represented by 2D/3D coordinates of human joints for sign language. We use the state of the art in Deep Learning for motion…
RefVOS: A Closer Look at Referring Expressions for Video Object Segmentation
Miriam Bellver, Carles Ventura, Carina Silberer +3
The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which t…
Mask-guided sample selection for Semi-Supervised Instance Segmentation
Miriam Bellver, Amaia Salvador, Jordi Torres +1
Image segmentation methods are usually trained with pixel-level annotations, which require significant human effort to collect. The most common solution to address this constraint…
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language
Amanda Duarte, Shruti Palaskar, Lucas Ventura +5
One of the factors that have hindered progress in the areas of sign language recognition, translation, and production is the absence of large annotated datasets. Towards this end,…
Transcription-Enriched Joint Embeddings for Spoken Descriptions of Images and Videos
Benet Oriol, Jordi Luque, Ferran Diego +1
In this work, we propose an effective approach for training unique embedding representations by combining three simultaneous modalities: image and spoken and textual narratives. Th…
Hate Speech in Pixels: Detection of Offensive Memes towards Automatic Moderation
Benet Oriol Sabat, Cristian Canton Ferrer, Xavier Giro-i-Nieto
This work addresses the challenge of hate speech detection in Internet memes, and attempts using visual information to automatically detect hate speech, unlike any previous work of…
Automatic Reminiscence Therapy for Dementia
Mariona Caros, Maite Garolera, Petia Radeva +1
With people living longer than ever, the number of cases with dementia such as Alzheimer's disease increases steadily. It affects more than 46 million people worldwide, and it is e…
Hyperparameter-Free Losses for Model-Based Monocular Reconstruction
Eduard Ramon, Guillermo Ruiz, Thomas Batard +1
This work proposes novel hyperparameter-free losses for single view 3D reconstruction with morphable models (3DMM). We dispense with the hyperparameters used in other works by expl…
Budget-aware Semi-Supervised Semantic and Instance Segmentation
Miriam Bellver, Amaia Salvador, Jordi Torres +1
Methods that move towards less supervised scenarios are key for image segmentation, as dense labels demand significant human intervention. Generally, the annotation burden is mitig…
Wav2Pix: Speech-conditioned Face Generation using Generative Adversarial Networks
Amanda Duarte, Francisco Roldan, Miquel Tubau +7
Speech is a rich biometric signal that contains information about the identity, gender and emotional state of the speaker. In this work, we explore its potential to generate face i…
RVOS: End-to-End Recurrent Network for Video Object Segmentation
Carles Ventura, Miriam Bellver, Andreu Girbau +3
Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the o…
Inverse Cooking: Recipe Generation from Food Images
Amaia Salvador, Michal Drozdzal, Xavier Giro-i-Nieto +1
People enjoy food photography because they appreciate food. Behind each meal there is a story described in a complex recipe and, unfortunately, by simply looking at a food image we…
Importance Weighted Evolution Strategies
Víctor Campos, Xavier Giro-i-Nieto, Jordi Torres
Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds…
Temporal Saliency Adaptation in Egocentric Videos
Panagiotis Linardos, Eva Mohedano, Monica Cherto +2
This work adapts a deep neural model for image saliency prediction to the temporal domain of egocentric video. We compute the saliency map for each video frame, firstly with an off…