47 citations · 143 across the 42 of their papers we have counts for
7 papers · 1 filter
Shared Multi-modal Embedding Space for Face-Voice Association
Christopher Simic, Korbinian Riedhammer, Tobias Bocklet
The FAME 2026 challenge comprises two demanding tasks: training face-voice associations combined with a multilingual setting that includes testing on languages on which the model w…
On the Difficulty of Token-Level Modeling of Dysfluency and Fluency Shaping Artifacts
Kashaf Gulzar, Dominik Wagner, Sebastian P. Bayerl +3
Automatic transcription of stuttered speech remains a challenge, even for modern end-to-end (E2E) automatic speech recognition (ASR) frameworks. Dysfluencies and fluency-shaping ar…
Generalizing to Unseen Disaster Events: A Causal View
Philipp Seeberger, Steffen Freisinger, Tobias Bocklet +1
Due to the rapid growth of social media platforms, these tools have become essential for monitoring information during ongoing disaster events. However, extracting valuable insight…
Pitfalls and Limits in Automatic Dementia Assessment
Franziska Braun, Christopher Witzl, Andreas Erzigkeit +4
Current work on speech-based dementia assessment focuses on either feature extraction to predict assessment scales, or on the automation of existing test procedures. Most research…
Personalized Fine-Tuning with Controllable Synthetic Speech from LLM-Generated Transcripts for Dysarthric Speech Recognition
Dominik Wagner, Ilja Baumann, Natalie Engert +4
In this work, we present our submission to the Speech Accessibility Project challenge for dysarthric speech recognition. We integrate parameter-efficient fine-tuning with latent au…
Adapter-Based Multi-Agent AVSR Extension for Pre-Trained ASR Models
Christopher Simic, Korbinian Riedhammer, Tobias Bocklet
We present an approach to Audio-Visual Speech Recognition that builds on a pre-trained Whisper model. To infuse visual information into this audio-only model, we extend it with an…
Optimized Self-supervised Training with BEST-RQ for Speech Recognition
Ilja Baumann, Dominik Wagner, Korbinian Riedhammer +1
Self-supervised learning has been successfully used for various speech related tasks, including automatic speech recognition. BERT-based Speech pre-Training with Random-projection…