34 citations · 74 across the 20 of their papers we have counts for
25 papers
Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection
Shruti Palaskar, Oggi Rudovic, Sameer Dharur +7
Although Large Language Models (LLMs) have shown promise for human-like conversations, they are primarily pre-trained on text data. Incorporating audio or video improves performanc…
Modality Dropout for Multimodal Device Directed Speech Detection using Verbal and Non-Verbal Features
Gautam Krishna, Sameer Dharur, Oggi Rudovic +4
Device-directed speech detection (DDSD) is the binary classification task of distinguishing between queries directed at a voice assistant versus side conversation or background spe…
Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition
Gautam Krishna, Mason Carnahan, Shilpa Shamapant +6
In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by ut…
Speech Recognition using EEG signals recorded using dry electrodes
Gautam Krishna, Co Tran, Mason Carnahan +2
In this paper, we demonstrate speech recognition using electroencephalography (EEG) signals obtained using dry electrodes on a limited English vocabulary consisting of three vowels…
Constrained Variational Autoencoder for improving EEG based Speech Recognition Systems
Gautam Krishna, Co Tran, Mason Carnahan +1
In this paper we introduce a recurrent neural network (RNN) based variational autoencoder (VAE) model with a new constrained loss function that can generate more meaningful electro…
Predicting Different Acoustic Features from EEG and towards direct synthesis of Audio Waveform from EEG
Gautam Krishna, Co Tran, Mason Carnahan +1
In [1,2] authors provided preliminary results for synthesizing speech from electroencephalography (EEG) features where they first predict acoustic features from EEG features and th…