341 citations · 430 across the 18 of their papers we have counts for
13 papers · 1 filter
Model Adaptation for ASR in low-resource Indian Languages
Abhayjeet Singh, Arjun Singh Mehta, Ashish Khuraishi K S +17
Automatic speech recognition (ASR) performance has improved drastically in recent years, mainly enabled by self-supervised learning (SSL) based acoustic models such as wav2vec2 and…
An unsupervised segmentation of vocal breath sounds
Shivani Yadav, Dipanjan Gope, Uma Maheswari K. +1
Breathing is an essential part of human survival, which carries information about a person's physiological and psychological state. Generally, breath boundaries are marked by exper…
Vocal Breath Sound Based Gender Classification
Mohammad Shaique Solanki, Ashutosh M Bharadwaj, Jeevan K +1
Voiced speech signals such as continuous speech are known to have acoustic features such as pitch(F0), and formant frequencies(F1, F2, F3) which can be used for gender classificati…
Real-Time MRI Video synthesis from time aligned phonemes with sequence-to-sequence networks
Sathvik Udupa, Prasanta Kumar Ghosh
Real-Time Magnetic resonance imaging (rtMRI) of the midsagittal plane of the mouth is of interest for speech production research. In this work, we focus on estimating utterance lev…
Improved acoustic-to-articulatory inversion using representations from pretrained self-supervised learning models
Sathvik Udupa, Siddarth C, Prasanta Kumar Ghosh
In this work, we investigate the effectiveness of pretrained Self-Supervised Learning (SSL) features for learning the mapping for acoustic to articulatory inversion (AAI). Signal p…
A study on native American English speech recognition by Indian listeners with varying word familiarity level
Abhayjeet Singh, Achuth Rao MV, Rakesh Vaideeswaran +2
In this study, listeners of varied Indian nativities are asked to listen and recognize TIMIT utterances spoken by American speakers. We have three kinds of responses from each list…
Multi-modal Point-of-Care Diagnostics for COVID-19 Based On Acoustics and Symptoms
Srikanth Raj Chetupalli, Prashant Krishnan, Neeraj Sharma +6
The research direction of identifying acoustic bio-markers of respiratory diseases has received renewed interest following the onset of COVID-19 pandemic. In this paper, we design…
Estimating articulatory movements in speech production with transformer networks
Sathvik Udupa, Anwesha Roy, Abhayjeet Singh +2
We estimate articulatory movements in speech production from different modalities - acoustics and phonemes. Acoustic-to articulatory inversion (AAI) is a sequence-to-sequence task.…
DiCOVA Challenge: Dataset, task, and baseline system for COVID-19 diagnosis using acoustics
Ananya Muguli, Lancelot Pinto, Nirmala R. +9
The DiCOVA challenge aims at accelerating research in diagnosing COVID-19 using acoustics (DiCOVA), a topic at the intersection of speech and audio processing, respiratory health d…
Speaker conditioned acoustic-to-articulatory inversion using x-vectors
Aravind Illa, Prasanta Kumar Ghosh
Speech production involves the movement of various articulators, including tongue, jaw, and lips. Estimating the movement of the articulators from the acoustics of speech is known…
Attention and Encoder-Decoder based models for transforming articulatory movements at different speaking rates
Abhayjeet Singh, Aravind Illa, Prasanta Kumar Ghosh
While speaking at different rates, articulators (like tongue, lips) tend to move differently and the enunciations are also of different durations. In the past, affine transformatio…
Coswara -- A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis
Neeraj Sharma, Prashant Krishnan, Rohit Kumar +5
The COVID-19 pandemic presents global challenges transcending boundaries of country, race, religion, and economy. The current gold standard method for COVID-19 detection is the rev…
A comparative study of estimating articulatory movements from phoneme sequences and acoustic features
Abhayjeet Singh, Aravind Illa, Prasanta Kumar Ghosh
Unlike phoneme sequences, movements of speech articulators (lips, tongue, jaw, velum) and the resultant acoustic signal are known to encode not only the linguistic message but also…