4 papers · 1 filter
MixCards: Evaluating Structured Descriptions of Multi-Source Sound Scenes
Sripathi Sridhar, Yujin Kim, Giovana Morais +6
Audio captioning benchmarks typically evaluate a single unstructured free-text description of an audio scene, providing limited insight into how a model fails to understand polypho…
Audiocards: Structured Metadata Improves Audio Language Models For Sound Design
Sripathi Sridhar, Prem Seetharaman, Oriol Nieto +2
Sound designers search for sounds in large sound effects libraries using aspects such as sound class or visual context. However, the metadata needed for such search is often missin…
Compositional Audio Representation Learning
Sripathi Sridhar, Mark Cartwright
Human auditory perception is compositional in nature -- we identify auditory streams from auditory scenes with multiple sound events. However, such auditory scenes are typically re…
Multi-label Open-set Audio Classification
Sripathi Sridhar, Mark Cartwright
Current audio classification models have small class vocabularies relative to the large number of sound event classes of interest in the real world. Thus, they provide a limited vi…