10 citations · 31 across the 11 of their papers we have counts for
13 papers
Pronouncing Hard Words: Phoneme Adaptation of a Pretrained Conversational Text to Speech Model
Yashish M. Siriwardena, Dinesh K. Gnanasekaran, Tanmay Laud +3
Voice agents built as cascaded automatic speech recognition (ASR)->large language model (LLM)-> text-to-speech (TTS) pipelines increasingly rely on conversational TTS: streaming, c…
HARP: Agentic Hybrid Retrieval and Analysis for Long-Form Audio
Chin-Jou Li, Masao Someki, Woojeong Jin +4
Long-form audio analysis requires systems to localize and integrate evidence distributed across extended recordings. While existing work primarily retrieves semantic content throug…
Accent Conversion with Articulatory Representations
Yashish M. Siriwardena, Nathan Swedlow, Audrey Howard +4
Conversion of non-native accented speech to native (American) English has a wide range of applications such as improving intelligibility of non-native speech. Previous work on this…
A multi-modal approach for identifying schizophrenia using cross-modal attention
Gowtham Premananth, Yashish M. Siriwardena, Philip Resnik +1
This study focuses on how different modalities of human communication can be used to distinguish between healthy controls and subjects with schizophrenia who exhibit strong positiv…
Improving Speech Inversion Through Self-Supervised Embeddings and Enhanced Tract Variables
Ahmed Adel Attia, Yashish M. Siriwardena, Carol Espy-Wilson
The performance of deep learning models depends significantly on their capacity to encode input features efficiently and decode them into meaningful outputs. Better input and outpu…
Speaker-independent Speech Inversion for Estimation of Nasalance
Yashish M. Siriwardena, Carol Espy-Wilson, Suzanne Boyce +2
The velopharyngeal (VP) valve regulates the opening between the nasal and oral cavities. This valve opens and closes through a coordinated motion of the velum and pharyngeal walls.…
Acoustic-to-Articulatory Speech Inversion Features for Mispronunciation Detection of /r/ in Child Speech Sound Disorders
Nina R Benway, Yashish M Siriwardena, Jonathan L Preston +3
Acoustic-to-articulatory speech inversion could enhance automated clinical mispronunciation detection to provide detailed articulatory feedback unattainable by formant-based mispro…
The Secret Source : Incorporating Source Features to Improve Acoustic-to-Articulatory Speech Inversion
Yashish M. Siriwardena, Carol Espy-Wilson
In this work, we incorporated acoustically derived source features, aperiodicity, periodicity and pitch as additional targets to an acoustic-to-articulatory speech inversion (SI) s…
Learning to Compute the Articulatory Representations of Speech with the MIRRORNET
Yashish M. Siriwardena, Carol Espy-Wilson, Shihab Shamma
Most organisms including humans function by coordinating and integrating sensory signals with motor actions to survive and accomplish desired tasks. Learning these complex sensorim…
Acoustic-to-articulatory Speech Inversion with Multi-task Learning
Yashish M. Siriwardena, Ganesh Sivaraman, Carol Espy-Wilson
Multi-task learning (MTL) frameworks have proven to be effective in diverse speech related tasks like automatic speech recognition (ASR) and speech emotion recognition. This paper…
Audio Data Augmentation for Acoustic-to-articulatory Speech Inversion using Bidirectional Gated RNNs
Yashish M. Siriwardena, Ahmed Adel Attia, Ganesh Sivaraman +1
Data augmentation has proven to be a promising prospect in improving the performance of deep learning models by adding variability to training data. In previous work with developin…
Multimodal Approach for Assessing Neuromotor Coordination in Schizophrenia Using Convolutional Neural Networks
Yashish M. Siriwardena, Chris Kitchen, Deanna L. Kelly +1
This study investigates the speech articulatory coordination in schizophrenia subjects exhibiting strong positive symptoms (e.g. hallucinations and delusions), using two distinct c…
The Mirrornet : Learning Audio Synthesizer Controls Inspired by Sensorimotor Interaction
Yashish M. Siriwardena, Guilhem Marion, Shihab Shamma
Experiments to understand the sensorimotor neural interactions in the human cortical speech system support the existence of a bidirectional flow of interactions between the auditor…