91 citations · 382 across the 29 of their papers we have counts for
37 papers
All In Good Time: Causality-Aware Framework for LLM-Based Simultaneous Speech-to-Speech Translation
Amir Hussein, Enas Albasiri, Travis M. Bartley +7
Large Language Models (LLMs) have shown strong performance in low-resource offline translation; however, extending them to simultaneous speech-to-speech translation (Simul-S2ST) re…
NemotronLabs VoiceChat: An Open Full-duplex Speech-to-Speech Model with Tool Calling Capabilities
Jagadeesh Balam, Travis Bartley, Edresson Casanova +52
We introduce NemotronLabs VoiceChat, an open full-duplex speech-to-speech model with native tool-calling capabilities. NemotronLabs VoiceChat combines a streaming speech encoder an…
ICASSP 2023 Deep Noise Suppression Challenge
Harishchandra Dubey, Ashkan Aazami, Vishak Gopal +9
Deep Speech Enhancement Challenge is the 5th edition of deep noise suppression (DNS) challenges organized at ICASSP 2023 Signal Processing Grand Challenges. DNS challenges were org…
ICASSP 2022 Deep Noise Suppression Challenge
Harishchandra Dubey, Vishak Gopal, Ross Cutler +8
The Deep Noise Suppression (DNS) challenge is designed to foster innovation in the area of noise suppression to achieve superior perceptual speech quality. This is the 4th DNS chal…
MusicNet: Compact Convolutional Neural Network for Real-time Background Music Detection
Chandan K. A. Reddy, Vishak Gopa, Harishchandra Dubey +3
With the recent growth of remote work, online meetings often encounter challenging audio contexts such as background noise, music, and echo. Accurate real-time detection of music e…
Interspeech 2021 Deep Noise Suppression Challenge
Chandan K A Reddy, Harishchandra Dubey, Kazuhito Koishida +7
The Deep Noise Suppression (DNS) challenge is designed to foster innovation in the area of noise suppression to achieve superior perceptual speech quality. We recently organized a…
ICASSP 2021 Deep Noise Suppression Challenge
Chandan K A Reddy, Harishchandra Dubey, Vishak Gopal +5
The Deep Noise Suppression (DNS) challenge is designed to foster innovation in the area of noise suppression to achieve superior perceptual speech quality. We recently organized a…
The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Results
Chandan K. A. Reddy, Vishak Gopal, Ross Cutler +10
The INTERSPEECH 2020 Deep Noise Suppression (DNS) Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subje…
Weighted Speech Distortion Losses for Neural-network-based Real-time Speech Enhancement
Yangyang Xia, Sebastian Braun, Chandan K. A. Reddy +3
This paper investigates several aspects of training a RNN (recurrent neural network) that impact the objective and subjective quality of enhanced speech for real-time single-channe…
CURE Dataset: Ladder Networks for Audio Event Classification
Harishchandra Dubey, Dimitra Emmanouilidou, Ivan J. Tashev
Audio event classification is an important task for several applications such as surveillance, audio, video and multimedia retrieval etc. There are approximately 3M people with hea…
The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Speech Quality and Testing Framework
Chandan K. A. Reddy, Ebrahim Beyrami, Harishchandra Dubey +10
The INTERSPEECH 2020 Deep Noise Suppression Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective…
Fuzzy C-Means Clustering and Sonification of HRV Features
Debanjan Borthakur, Victoria Grace, Paul Batchelor +2
Linear and non-linear measures of heart rate variability (HRV) are widely investigated as non-invasive indicators of health. Stress has a profound impact on heart rate, and differe…
Toeplitz Inverse Covariance based Robust Speaker Clustering for Naturalistic Audio Streams
Harishchandra Dubey, Abhijeet Sangwan, John Hansen
Speaker diarization determines who spoke and when? in an audio stream. In this study, we propose a model-based approach for robust speaker clustering using i-vectors. The ivectors…
Robust Speaker Clustering using Mixtures of von Mises-Fisher Distributions for Naturalistic Audio Streams
Harishchandra Dubey, Abhijeet Sangwan, John H. L. Hansen
Speaker Diarization (i.e. determining who spoke and when?) for multi-speaker naturalistic interactions such as Peer-Led Team Learning (PLTL) sessions is a challenging task. In this…
SmartEAR: Smartwatch-based Unsupervised Learning for Multi-modal Signal Analysis in Opportunistic Sensing Framework
Debanjan Borthakur, Andrew Peltier, Harishchandra Dubey +2
Wrist-bands such as smartwatches have become an unobtrusive interface for collecting physiological and contextual data from users. Smartwatches are being used for smart healthcare,…
Robust Feature Clustering for Unsupervised Speech Activity Detection
Harishchandra Dubey, Abhijeet Sangwan, John H. L. Hansen
In certain applications such as zero-resource speech processing or very-low resource speech-language systems, it might not be feasible to collect speech activity detection (SAD) an…
Fog Computing based SDI Framework for Mineral Resources Information Infrastructure Management in India
Rabindra K. Barik, Rakesh K. Lenka, N. V. R. Simha +2
Spatial Data Infrastructure (SDI) is an important concept for sharing spatial data across the web. With cumulative techniques with spatial cloud computing and fog computing, SDI ha…
FogGrid: Leveraging Fog Computing for Enhanced Smart Grid Network
Rabindra K. Barik, Satish Kumar Gudey, Gujji Giridhar Reddy +4
The present manuscript concentrates on the application of Fog computing to a Smart Grid Network that comprises of a Distribution Generation System known as a Microgrid. It addresse…
Smart Fog: Fog Computing Framework for Unsupervised Clustering Analytics in Wearable Internet of Things
Debanjan Borthakur, Harishchandra Dubey, Nicholas Constant +2
The increasing use of wearables in smart telehealth generates heterogeneous medical big data. Cloud and fog services process these data for assisting clinical procedures. IoT based…
SoA-Fog: Secure Service-Oriented Edge Computing Architecture for Smart Health Big Data Analytics
Rabindra K. Barik, Harishchandra Dubey, Kunal Mankodiya
The smart health paradigms employ Internet-connected wearables for telemonitoring, diagnosis for providing inexpensive healthcare solutions. Fog computing reduces latency and incre…
FAIR: A Hadoop-based Hybrid Model for Faculty Information Retrieval System
Noopur Gupta, Rakesh K. Lenka, Rabindra K. Barik +1
In era of ever-expanding data and knowledge, we lack a centralized system that maps all the faculties to their research works. This problem has not been addressed in the past and i…
Fog Computing in Medical Internet-of-Things: Architecture, Implementation, and Applications
Harishchandra Dubey, Admir Monteiro, Nicholas Constant +7
In the era when the market segment of Internet of Things (IoT) tops the chart in various business reports, it is apparently envisioned that the field of medicine expects to gain a…
Using Speech Technology for Quantifying Behavioral Characteristics in Peer-Led Team Learning Sessions
Harishchandra Dubey, Abhijeet Sangwan, John H. L. Hansen
Peer-Led Team Learning (PLTL) is a learning methodology where a peer-leader co-ordinate a small-group of students to collaboratively solve technical problems. PLTL have been adopte…
Fog-Assisted wIoT: A Smart Fog Gateway for End-to-End Analytics in Wearable Internet of Things
Nicholas Constant, Debanjan Borthakur, Mohammadreza Abtahi +2
Today, wearable internet-of-things (wIoT) devices continuously flood the cloud data centers at an enormous rate. This increases a demand to deploy an edge infrastructure for comput…