CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification

Yuan Gong, Sameer Khurana, Andrew Rouditchenko +1

Audio classification is an active research area with a wide range of applications. Over the past decade, convolutional neural networks (CNNs) have been the de-facto standard buildi…