341 citations · 501 across the 66 of their papers we have counts for
55 papers · 1 filter
JASPER: Joint Audio and Speech Pre-trained Encoder Representations
Geeth George, Ameenudeen P E, Hrishikesh H Pillai +1
Self-supervised learning (SSL) for speech and audio has largely progressed along separate tracks: speech models emphasise time-domain prediction, whereas audio representation learn…
ULTRAS -- Unified Learning of Transformer Representations for Audio and Speech Signals
Ameenudeen P E, Charumathi Narayanan, Sriram Ganapathy
Self-supervised learning (SSL) has driven impressive advances in speech processing by adopting time-domain prediction objectives, while audio representation learning frameworks ope…
Benchmarking Speech Systems for Frontline Health Conversations: The DISPLACE-M Challenge
Dhanya E, Ankita Meena, Manas Nanivadekar +11
The DIarization and Speech Processing for LAnguage understanding in Conversational Environments - Medical (DISPLACE-M) challenge introduces a conversational AI benchmark for unders…
Benchmarking Humans and Machines on Complex Multilingual Speech Understanding Tasks
Sai Samrat Kankanala, Ram Chandra, Sriram Ganapathy
Auditory attention and selective phase-locking are central to human speech understanding in complex acoustic scenes and cocktail party settings, yet these capabilities in multiling…
Textless and Non-Parallel Speech-to-Speech Emotion Style Transfer
Soumya Dutta, Avni Jain, Sriram Ganapathy
Given a pair of source and reference speech recordings, speech-to-speech (S2S) emotion style transfer involves the generation of an output speech that mimics the emotion characteri…
LLM supervised Pre-training for Multimodal Emotion Recognition in Conversations
Soumya Dutta, Sriram Ganapathy
Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition mod…
Uncovering the role of semantic and acoustic cues in normal and dichotic listening
Sai Samrat Kankanala, Akshara Soman, Sriram Ganapathy
Speech comprehension is an involuntary task for the healthy human brain, yet the understanding of the mechanisms underlying this brain functionality remains obscure. In this paper,…
Leveraging Content and Acoustic Representations for Speech Emotion Recognition
Soumya Dutta, Sriram Ganapathy
Speech emotion recognition (SER), the task of identifying the expression of emotion from spoken content, is challenging due to the difficulty in extracting representations that cap…
The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environments
Shareef Babu Kalluri, Prachi Singh, Pratik Roy Chowdhuri +8
The DIarization of SPeaker and LAnguage in Conversational Environments (DISPLACE) 2024 challenge is the second in the series of DISPLACE challenges, which involves tasks of speaker…
Zero Shot Audio to Audio Emotion Transfer With Speaker Disentanglement
Soumya Dutta, Sriram Ganapathy
The problem of audio-to-audio (A2A) style transfer involves replacing the style features of the source audio with those from the target audio while preserving the content related a…
End-to-End Supervised Hierarchical Graph Clustering for Speaker Diarization
Prachi Singh, Sriram Ganapathy
Speaker diarization, the task of segmenting an audio recording based on speaker identity, constitutes an important speech pre-processing step for several downstream applications.Th…
Summary of the DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environments
Shikha Baghel, Shreyas Ramoji, Somil Jain +4
In multi-lingual societies, where multiple languages are spoken in a small geographic vicinity, informal conversations often involve mix of languages. Existing speech technologies…
Speech enhancement with frequency domain auto-regressive modeling
Anurenjan Purushothaman, Debottam Dutta, Rohit Kumar +1
Speech applications in far-field real world settings often deal with signals that are corrupted by reverberation. The task of dereverberation constitutes an important step to impro…
Representation Learning With Hidden Unit Clustering For Low Resource Speech Applications
Varun Krishna, Tarun Sai, Sriram Ganapathy
The representation learning of speech, without textual resources, is an area of significant interest for many low resource speech applications. In this paper, we describe an approa…
Enhancing the EEG Speech Match Mismatch Tasks With Word Boundaries
Akshara Soman, Vidhi Sinha, Sriram Ganapathy
Recent studies have shown that the underlying neural mechanisms of human speech comprehension can be analyzed using a match-mismatch classification of the speech stimulus and the n…
Coswara: A respiratory sounds and symptoms dataset for remote screening of SARS-CoV-2 infection
Debarpan Bhattacharya, Neeraj Kumar Sharma, Debottam Dutta +8
This paper presents the Coswara dataset, a dataset containing diverse set of respiratory sounds and rich meta-data, recorded between April-2020 and February-2022 from 2635 individu…
HCAM -- Hierarchical Cross Attention Model for Multi-modal Emotion Recognition
Soumya Dutta, Sriram Ganapathy
Emotion recognition in conversations is challenging due to the multi-modal nature of the emotion expression. We propose a hierarchical cross-attention model (HCAM) approach to mult…
DISPLACE Challenge: DIarization of SPeaker and LAnguage in Conversational Environments
Shikha Baghel, Shreyas Ramoji, Sidharth +8
In multilingual societies, social conversations often involve code-mixed speech. The current speech technology may not be well equipped to extract information from multi-lingual mu…
Interpretable Acoustic Representation Learning on Breathing and Speech Signals for COVID-19 Detection
Debottam Dutta, Debarpan Bhattacharya, Sriram Ganapathy +3
In this paper, we describe an approach for representation learning of audio signals for the task of COVID-19 detection. The raw audio samples are processed with a bank of 1-D convo…
Analyzing the impact of SARS-CoV-2 variants on respiratory sound signals
Debarpan Bhattacharya, Debottam Dutta, Neeraj Kumar Sharma +8
The COVID-19 outbreak resulted in multiple waves of infections that have been associated with different SARS-CoV-2 variants. Studies have reported differential impact of the varian…
Svadhyaya system for the Second Diagnosing COVID-19 using Acoustics Challenge 2021
Deepak Mittal, Amir H. Poorjam, Debottam Dutta +4
This report describes the system used for detecting COVID-19 positives using three different acoustic modalities, namely speech, breathing, and cough in the second DiCOVA challenge…
The Second DiCOVA Challenge: Dataset and performance analysis for COVID-19 diagnosis using acoustics
Neeraj Kumar Sharma, Srikanth Raj Chetupalli, Debarpan Bhattacharya +3
The Second Diagnosis of COVID-19 using Acoustics (DiCOVA) Challenge aimed at accelerating the research in acoustics based detection of COVID-19, a topic at the intersection of acou…
Self-Supervised Metric Learning With Graph Clustering For Speaker Diarization
Prachi Singh, Sriram Ganapathy
In this paper, we propose a novel algorithm for speaker diarization using metric learning for graph based clustering. The graph clustering algorithms use an adjacency matrix consis…
Dereverberation of Autoregressive Envelopes for Far-field Speech Recognition
Anurenjan Purushothaman, Anirudh Sreeram, Rohit Kumar +1
The task of speech recognition in far-field environments is adversely affected by the reverberant artifacts that elicit as the temporal smearing of the sub-band envelopes. In this…