Class Token and Knowledge Distillation for Multi-head Self-Attention Speaker Verification Systems

Victoria Mingote, Antonio Miguel, Alfonso Ortega +1

This paper explores three novel approaches to improve the performance of speaker verification (SV) systems based on deep neural networks (DNN) using Multi-head Self-Attention (MSA)…