64 citations · 146 across the 15 of their papers we have counts for
16 papers
An Initial Investigation of Language Adaptation for TTS Systems under Low-resource Scenarios
Cheng Gong, Erica Cooper, Xin Wang +9
Self-supervised learning (SSL) representations from massively multilingual models offer a promising solution for low-resource language speech tasks. Despite advancements, language…
ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations
Cheng Gong, Xin Wang, Erica Cooper +5
Neural text-to-speech (TTS) has achieved human-like synthetic speech for single-speaker, single-language synthesis. Multilingual TTS systems are limited to resource-rich languages…
Predicting pairwise preferences between TTS audio stimuli using parallel ratings data and anti-symmetric twin neural networks
Cassia Valentini-Botinhao, Manuel Sam Ribeiro, Oliver Watts +2
Automatically predicting the outcome of subjective listening tests is a challenging task. Ratings may vary from person to person even if preferences are consistent across listeners…
Automatic audiovisual synchronisation for ultrasound tongue imaging
Aciel Eshky, Joanne Cleland, Manuel Sam Ribeiro +3
Ultrasound tongue imaging is used to visualise the intra-oral articulators during speech production. It is utilised in a range of applications, including speech and language therap…
Silent versus modal multi-speaker speech recognition from ultrasound and video
Manuel Sam Ribeiro, Aciel Eshky, Korin Richmond +1
We investigate multi-speaker speech recognition from ultrasound images of the tongue and video images of the lips. We train our systems on imaging data from modal speech, and evalu…
Exploiting ultrasound tongue imaging for the automatic detection of speech articulation errors
Manuel Sam Ribeiro, Joanne Cleland, Aciel Eshky +2
Speech sound disorders are a common communication impairment in childhood. Because speech disorders can negatively affect the lives and the development of children, clinical interv…
TaL: a synchronised multi-speaker corpus of ultrasound tongue imaging, audio, and lip videos
Manuel Sam Ribeiro, Jennifer Sanger, Jing-Xuan Zhang +4
We present the Tongue and Lips corpus (TaL), a multi-speaker corpus of audio, ultrasound tongue imaging, and lip videos. TaL consists of two parts: TaL1 is a set of six recording s…
Ultrasound tongue imaging for diarization and alignment of child speech therapy sessions
Manuel Sam Ribeiro, Aciel Eshky, Korin Richmond +1
We investigate the automatic processing of child speech therapy sessions using ultrasound visual biofeedback, with a specific focus on complementing acoustic features with ultrasou…
Speaker-independent classification of phonetic segments from raw ultrasound in child speech
Manuel Sam Ribeiro, Aciel Eshky, Korin Richmond +1
Ultrasound tongue imaging (UTI) provides a convenient way to visualize the vocal tract during speech production. UTI is increasingly being used for speech therapy, making it import…
UltraSuite: A Repository of Ultrasound and Acoustic Data from Child Speech Therapy Sessions
Aciel Eshky, Manuel Sam Ribeiro, Joanne Cleland +4
We introduce UltraSuite, a curated repository of ultrasound and acoustic data, collected from recordings of child speech therapy sessions. This release includes three data collecti…
Synchronising audio and ultrasound by learning cross-modal embeddings
Aciel Eshky, Manuel Sam Ribeiro, Korin Richmond +1
Audiovisual synchronisation is the task of determining the time offset between speech audio and a video recording of the articulators. In child speech therapy, audio and ultrasound…
Attentive Filtering Networks for Audio Replay Attack Detection
Cheng-I Lai, Alberto Abad, Korin Richmond +3
An attacker may use a variety of techniques to fool an automatic speaker verification system into accepting them as a genuine user. Anti-spoofing methods meanwhile aim to make the…
A Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract
Alexander Hewer, Stefanie Wuhrer, Ingmar Steiner +1
We present a multilinear statistical model of the human tongue that captures anatomical and tongue pose related shape variations separately. The model is derived from 3D magnetic r…
A statistical shape space model of the palate surface trained on 3D MRI scans of the vocal tract
Alexander Hewer, Ingmar Steiner, Timo Bolkart +2
We describe a minimally-supervised method for computing a statistical shape space model of the palate surface. The model is created from a corpus of volumetric magnetic resonance i…
Speech animation using electromagnetic articulography as motion capture data
Ingmar Steiner, Korin Richmond, Slim Ouni
Electromagnetic articulography (EMA) captures the position and orientation of a number of markers, attached to the articulators, during speech. As such, it performs the same functi…
Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis
Ingmar Steiner, Korin Richmond, Slim Ouni
The importance of modeling speech articulation for high-quality audiovisual (AV) speech synthesis is widely acknowledged. Nevertheless, while state-of-the-art, data-driven approach…