4 papers
DAVSS: Distilled Audio-Visual State Space Models
Saurabhchand Bhati, Mrudula Athi, Amit S. Chhetri +1
State-space models (SSMs) distilled from transformer teachers combine the performance of transformers with the efficiency of SSMs. We extend the Transformer-SSM knowledge distillat…
USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding
Heng-Jui Chang, Alexander H. Liu, Saurabhchand Bhati +4
Audio encoders are critical to modern audio applications as large language models (LLMs) increasingly rely on a single encoder for diverse inputs. While self-supervised learning (S…
On Acoustic Modeling for Broadband Beamforming
Amit Chhetri, Mohamed Mansour, Wontak Kim +1
In this work, we describe limitations of the free-field propagation model for designing broadband beamformers for microphone arrays on a rigid surface. Towards this goal, we descri…
Reconfigurable Multitask Audio Dynamics Processing Scheme
Jun Yang, Amit S. Chhetri, Carlo Murgia +1
Automatic speech recognition (ASR), audio quality, and loudness are key performance indicators (KPIs) in smart speakers. To improve all these KPIs, audio dynamics processing is a c…