An Adapter Based Pre-Training for Efficient and Scalable Self-Supervised Speech Representation Learning

Samuel Kessler, Bethan Thomas, Salah Karout

We present a method for transferring pre-trained self-supervised (SSL) speech representations to multiple languages. There is an abundance of unannotated speech, so creating self-s…