Transfer Learning of Transformer-based Speech Recognition Models from Czech to Slovak

Jan Lehečka, Josef V. Psutka, Josef Psutka

In this paper, we are comparing several methods of training the Slovak speech recognition models based on the Transformers architecture. Specifically, we are exploring the approach…