46 citations · 105 across the 14 of their papers we have counts for
20 papers
MambaVoice: Lightweight Audiovisual Singing Voice Separation Via A Hybrid Mamba-Transformer Model
Adithi Shankar, Gopika Krishnan, Gloria Haro +2
Isolating a target singing voice from a music video remains challenging, particularly in the presence of multiple vocalists and dense instrumental accompaniment. We propose MambaVo…
Speech inpainting: Context-based speech synthesis guided by video
Juan F. Montesinos, Daniel Michelsanti, Gloria Haro +2
Audio and visual modalities are inherently connected in speech signals: lip movements and facial expressions are correlated with speech sounds. This motivates studies that incorpor…
A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classification
Alejandro Cartas, Coloma Ballester, Gloria Haro
Action spotting in soccer videos is the task of identifying the specific time when a certain key action of the game occurs. Lately, it has received a large amount of attention and…
VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
Venkatesh S. Kadandale, Juan F. Montesinos, Gloria Haro
In this paper, we address the problem of lip-voice synchronisation in videos containing human face and voice. Our approach is based on determining if the lips motion and the voice…
VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformer
Juan F. Montesinos, Venkatesh S. Kadandale, Gloria Haro
This paper presents an audio-visual approach for voice separation which produces state-of-the-art results at a low latency in two scenarios: speech and singing voice. The model is…
Learning Football Body-Orientation as a Matter of Classification
Adrià Arbués-Sangüesa, Adrián Martín, Paulino Granero +2
Orientation is a crucial skill for football players that becomes a differential factor in a large set of events, especially the ones involving passes. However, existing orientation…
A cappella: Audio-visual Singing Voice Separation
Juan F. Montesinos, Venkatesh S. Kadandale, Gloria Haro
The task of isolating a target singing voice in music videos has useful applications. In this work, we explore the single-channel singing voice separation problem from a multimodal…
Self-Supervised Small Soccer Player Detection and Tracking
Samuel Hurault, Coloma Ballester, Gloria Haro
In a soccer game, the information provided by detecting and tracking brings crucial clues to further analyze and understand some tactical aspects of the game, including individual…
Solos: A Dataset for Audio-Visual Music Analysis
Juan F. Montesinos, Olga Slizovskaia, Gloria Haro
In this paper, we present a new dataset of music performance videos which can be used for training machine learning methods for multiple tasks such as audio-visual blind source sep…
Using Player's Body-Orientation to Model Pass Feasibility in Soccer
Adrià Arbués-Sangüesa, Adrián Martín, Javier Fernández +2
Given a monocular video of a soccer match, this paper presents a computational model to estimate the most feasible pass at any given time. The method leverages offensive player's o…
Conditioned Source Separation for Music Instrument Performances
Olga Slizovskaia, Gloria Haro, Emilia Gómez
In music source separation, the number of sources may vary for each piece and some of the sources may belong to the same family of instruments, thus sharing timbral characteristics…
Vocoder-Based Speech Synthesis from Silent Videos
Daniel Michelsanti, Olga Slizovskaia, Gloria Haro +3
Both acoustic and visual information influence human perception of speech. For this reason, the lack of audio in a video sequence determines an extremely low speech intelligibility…
Multi-channel U-Net for Music Source Separation
Venkatesh S. Kadandale, Juan F. Montesinos, Gloria Haro +1
A fairly straightforward approach for music source separation is to train independent models, wherein each model is dedicated for estimating only a specific source. Training a sing…
Always Look on the Bright Side of the Field: Merging Pose and Contextual Data to Estimate Orientation of Soccer Players
Adrià Arbués-Sangüesa, Adrián Martín, Javier Fernández +3
Although orientation has proven to be a key skill of soccer players in order to succeed in a broad spectrum of plays, body orientation is a yet-little-explored area in sports analy…
Multi-Person tracking by multi-scale detection in Basketball scenarios
Adrià Arbués-Sangüesa, Gloria Haro, Coloma Ballester
Tracking data is a powerful tool for basketball teams in order to extract advanced semantic information and statistics that might lead to a performance boost. However, multi-person…
Single-Camera Basketball Tracker through Pose and Semantic Feature Fusion
Adrià Arbués-Sangüesa, Coloma Ballester, Gloria Haro
Tracking sports players is a widely challenging scenario, specially in single-feed videos recorded in tight courts, where cluttering and occlusions cannot be avoided. This paper pr…
A Case Study of Deep-Learned Activations via Hand-Crafted Audio Features
Olga Slizovskaia, Emilia Gómez, Gloria Haro
The explainability of Convolutional Neural Networks (CNNs) is a particularly challenging task in all areas of application, and it is notably under-researched in music and audio dom…
End-to-End Sound Source Separation Conditioned On Instrument Labels
Olga Slizovskaia, Leo Kim, Gloria Haro +1
Can we perform an end-to-end music source separation with a variable number of sources using a deep learning model? We present an extension of the Wave-U-Net model which allows end…
FALDOI: A new minimization strategy for large displacement variational optical flow
Roberto P. Palomares, Enric Meinhardt-Llopis, Coloma Ballester +1
We propose a large displacement optical flow method that introduces a new strategy to compute a good local minimum of any optical flow energy functional. The method requires a give…
A Computational Model for Amodal Completion
Maria Oliver, Gloria Haro, Mariella Dimiccoli +2
This paper presents a computational model to recover the most likely interpretation of the 3D scene structure from a planar image, where some objects may occlude others. The estima…