DAVSS: Distilled Audio-Visual State Space Models

Saurabhchand Bhati, Mrudula Athi, Amit S. Chhetri +1

State-space models (SSMs) distilled from transformer teachers combine the performance of transformers with the efficiency of SSMs. We extend the Transformer-SSM knowledge distillat…