94 citations · 109 across the 8 of their papers we have counts for
10 papers
TILES-2018 Sleep Benchmark Dataset: A Longitudinal Wearable Sleep Data Set of Hospital Workers for Modeling and Understanding Sleep Behaviors
Tiantian Feng, Brandon M Booth, Karel Mundnich +4
Sleep is important for everyday functioning, overall well-being, and quality of life. Recent advances in wearable sensing technology have enabled continuous, noninvasive, and cost-…
Speech Retrieval-Augmented Generation without Automatic Speech Recognition
Do June Min, Karel Mundnich, Andy Lapastora +3
One common approach for question answering over speech data is to first transcribe speech using automatic speech recognition (ASR) and then employ text-based retrieval-augmented ge…
Zero-resource Speech Translation and Recognition with LLMs
Karel Mundnich, Xing Niu, Prashant Mathur +10
Despite recent advancements in speech processing, zero-resource speech translation (ST) and automatic speech recognition (ASR) remain challenging problems. In this work, we propose…
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models
Raghuveer Peri, Sai Muralidhar Jayanthi, Srikanth Ronanki +11
Integrated Speech and Large Language Models (SLMs) that can follow speech instructions and generate relevant text responses have gained popularity lately. However, the safety and r…
SpeechVerse: A Large-scale Generalizable Audio Language Model
Nilaksh Das, Saket Dingliwal, Srikanth Ronanki +14
Large language models (LLMs) have shown incredible proficiency in performing tasks that require semantic understanding of natural language instructions. Recently, many works have f…
Audiovisual Highlight Detection in Videos
Karel Mundnich, Alexandra Fenster, Aparna Khare +1
In this paper, we test the hypothesis that interesting events in unstructured videos are inherently audiovisual. We combine deep image representations for object recognition and sc…
Bringing in the outliers: A sparse subspace clustering approach to learn a dictionary of mouse ultrasonic vocalizations
Jiaxi Wang, Karel Mundnich, Allison T. Knoll +2
Mice vocalize in the ultrasonic range during social interactions. These vocalizations are used in neuroscience and clinical studies to tap into complex behaviors and states. The an…
TILES-2018, a longitudinal physiologic and behavioral data set of hospital workers
Karel Mundnich, Brandon M. Booth, Michelle L'Hommedieu +11
We present a novel longitudinal multimodal corpus of physiological and behavioral data collected from direct clinical providers in a hospital workplace. We designed the study to in…
Characterizing dynamically varying acoustic scenes from egocentric audio recordings in workplace setting
Arindam Jati, Amrutha Nadarajan, Karel Mundnich +1
Devices capable of detecting and categorizing acoustic scenes have numerous applications such as providing context-aware user experiences. In this paper, we address the task of cha…
Generating Labels for Regression of Subjective Constructs using Triplet Embeddings
Karel Mundnich, Brandon M. Booth, Benjamin Girault +1
Human annotations serve an important role in computational models where the target constructs under study are hidden, such as dimensions of affect. This is especially relevant in m…