On-demand compute reduction with stochastic wav2vec 2.0

Apoorv Vyas, Wei-Ning Hsu, Michael Auli +1

Squeeze and Efficient Wav2vec (SEW) is a recently proposed architecture that squeezes the input to the transformer encoder for compute efficient pre-training and inference with wav…