7 citations · 20 across the 12 of their papers we have counts for
14 papers
When Layer Selection Misleads Speech Depression Detection
Paula A. Perez-Toro, David Gimeno-Gómez, Daniel Rückert +1
Pretrained speech representations are increasingly used for depression detection, but selecting the best encoder layer on the same data used for evaluation biases reported performa…
CARE: A Multimodal Corpus for Studying Speech and Non-Verbal Communication Across Multiple Medical Conditions
David Gimeno-Gómez, Catarina Botelho, Carlos-D. Martínez-Hinarejos +2
Automatic analysis of multimodal speech has shown strong potential for computationally detecting and monitoring a wide range of neurological, psychiatric, and respiratory condition…
Cross-Modal Masking for Robust Silent Speech Synthesis Using sEMG and Lipreading
Eder del Blanco, David Gimeno-Gómez, Eva Navas +2
Speech restoration through silent speech interfaces (SSIs) has emerged as a promising assistive technology for individuals with impaired or absent laryngeal voice production. Among…
MEMEWEAVER: Inter-Meme Graph Reasoning for Sexism and Misogyny Detection
Paolo Italiani, David Gimeno-Gomez, Luca Ragazzi +2
Women are twice as likely as men to face online harassment due to their gender. Despite recent advances in multimodal content moderation, most approaches still overlook the social…
On the Relevance of Clinical Assessment Tasks for the Automatic Detection of Parkinson's Disease Medication State from Speech
David Gimeno-Gómez, Rubén Solera-Ureña, Anna Pompili +5
The automatic identification of medication states of Parkinson's disease (PD) patients can assist clinicians in monitoring and scheduling personalized treatments, as well as studyi…
Evaluation of End-to-End Continuous Spanish Lipreading in Different Data Conditions
David Gimeno-Gómez, Carlos-D. Martínez-Hinarejos
Visual speech recognition remains an open research problem where different challenges must be considered by dispensing with the auditory sense, such as visual ambiguities, the inte…
Tackling Cognitive Impairment Detection from Speech: A submission to the PROCESS Challenge
Catarina Botelho, David Gimeno-Gómez, Francisco Teixeira +11
This work describes our group's submission to the PROCESS Challenge 2024, with the goal of assessing cognitive decline through spontaneous speech, using three guided clinical tasks…
Unveiling Interpretability in Self-Supervised Speech Representations for Parkinson's Diagnosis
David Gimeno-Gómez, Catarina Botelho, Anna Pompili +2
Recent works in pathological speech analysis have increasingly relied on powerful self-supervised speech representations, leading to promising results. However, the complex, black-…
Tailored Design of Audio-Visual Speech Recognition Models using Branchformers
David Gimeno-Gómez, Carlos-D. Martínez-Hinarejos
Recent advances in Audio-Visual Speech Recognition (AVSR) have led to unprecedented achievements in the field, improving the robustness of this type of system in adverse, noisy env…
AnnoTheia: A Semi-Automatic Annotation Toolkit for Audio-Visual Speech Technologies
José-M. Acosta-Triana, David Gimeno-Gómez, Carlos-D. Martínez-Hinarejos
More than 7,000 known languages are spoken around the world. However, due to the lack of annotated resources, only a small fraction of them are currently covered by speech technolo…
Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition
David Gimeno-Gómez, Carlos-D. Martínez-Hinarejos
Thanks to the rise of deep learning and the availability of large-scale audio-visual databases, recent advances have been achieved in Visual Speech Recognition (VSR). Similar to ot…
Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cues
David Gimeno-Gómez, Ana-Maria Bucur, Adrian Cosma +2
Depression, a prominent contributor to global disability, affects a substantial portion of the population. Efforts to detect depression from social media texts have been prevalent,…
Speaker-Adapted End-to-End Visual Speech Recognition for Continuous Spanish
David Gimeno-Gómez, Carlos-D. Martínez-Hinarejos
Different studies have shown the importance of visual cues throughout the speech perception process. In fact, the development of audiovisual approaches has led to advances in the f…
LIP-RTVE: An Audiovisual Database for Continuous Spanish in the Wild
David Gimeno-Gómez, Carlos-D. Martínez-Hinarejos
Speech is considered as a multi-modal process where hearing and vision are two fundamentals pillars. In fact, several studies have demonstrated that the robustness of Automatic Spe…