6 papers
VocSegMRI: Multimodal Learning for Precise Vocal Tract Segmentation in Real-time MRI
Daiqi Liu, Johannes Enk, Maureen Stone +7
Accurate segmentation of articulatory structures in real-time MRI (rtMRI) remains challenging, as existing methods rely primarily on visual cues and overlook complementary informat…
A Speech-to-Video Synthesis Approach Using Spatio-Temporal Diffusion for Vocal Tract MRI
Paula Andrea Pérez-Toro, Tomás Arias-Vergara, Fangxu Xing +9
Understanding the relationship between vocal tract motion during speech and the resulting acoustic signal is crucial for aided clinical assessment and developing personalized treat…
Speech motion anomaly detection via cross-modal translation of 4D motion fields from tagged MRI
Xiaofeng Liu, Fangxu Xing, Jiachen Zhuo +4
Understanding the relationship between tongue motion patterns during speech and their resulting speech acoustic outcomes -- i.e., articulatory-acoustic relation -- is of great impo…
Speech Audio Synthesis from Tagged MRI and Non-Negative Matrix Factorization via Plastic Transformer
Xiaofeng Liu, Fangxu Xing, Maureen Stone +5
The tongue's intricate 3D structure, comprising localized functional units, plays a crucial role in the production of speech. When measured using tagged MRI, these functional units…
Attentive Continuous Generative Self-training for Unsupervised Domain Adaptive Medical Image Translation
Xiaofeng Liu, Jerry L. Prince, Fangxu Xing +5
Self-training is an important class of unsupervised domain adaptation (UDA) approaches that are used to mitigate the problem of domain shift, when applying knowledge learned from a…
Tagged-MRI Sequence to Audio Synthesis via Self Residual Attention Guided Heterogeneous Translator
Xiaofeng Liu, Fangxu Xing, Jerry L. Prince +4
Understanding the underlying relationship between tongue and oropharyngeal muscle deformation seen in tagged-MRI and intelligible speech plays an important role in advancing speech…