1.6k citations · 1.7k across the 13 of their papers we have counts for
20 papers
Training Audio Captioning Models without Audio
Soham Deshmukh, Benjamin Elizalde, Dimitra Emmanouilidou +3
Automated Audio Captioning (AAC) is the task of generating natural language descriptions given an audio stream. A typical AAC system requires manually curated training data of audi…
Pengi: An Audio Language Model for Audio Tasks
Soham Deshmukh, Benjamin Elizalde, Rita Singh +1
In the domain of audio processing, Transfer Learning has facilitated the rise of Self-Supervised Learning and Zero-Shot Learning techniques. These approaches have led to the develo…
Synergy between human and machine approaches to sound/scene recognition and processing: An overview of ICASSP special session
Laurie M. Heller, Benjamin Elizalde, Bhiksha Raj +1
Machine Listening, as usually formalized, attempts to perform a task that is, from our perspective, fundamentally human-performable, and performed by humans. Current automated mode…
Describing emotions with acoustic property prompts for speech emotion recognition
Hira Dhamyal, Benjamin Elizalde, Soham Deshmukh +3
Emotions lie on a broad continuum and treating emotions as a discrete number of classes limits the ability of a model to capture the nuances in the continuum. The challenge is how…
Audio Retrieval with WavText5K and CLAP Training
Soham Deshmukh, Benjamin Elizalde, Huaming Wang
Audio-Text retrieval takes a natural language query to retrieve relevant audio files in a database. Conversely, Text-Audio retrieval takes an audio file as a query to retrieve rele…
COVID-19 Detection Using Recorded Coughs in the 2021 DiCOVA Challenge
Benjamin Elizalde, Daniel Tompkins
COVID-19 has resulted in over 100 million infections and caused worldwide lock downs due to its high transmission rate and limited testing options. Current diagnostic tests can be…