2 papers
cs.CL2023
On-Device Constrained Self-Supervised Speech Representation Learning for Keyword Spotting via Knowledge Distillation
Gene-Ping Yang, Yue Gu, Qingming Tang +2
Large self-supervised models are effective feature extractors, but their application is challenging under on-device budget constraints and biased dataset collection, especially in…
cs.SD2023
Small-footprint slimmable networks for keyword spotting
Zuhaib Akhtar, Mohammad Omar Khursheed, Dongsu Du +1
In this work, we present Slimmable Neural Networks applied to the problem of small-footprint keyword spotting. We show that slimmable neural networks allow us to create super-nets…