Improving Speaker Verification with Self-Pretrained Transformer Models

Junyi Peng, Oldřich Plchot, Themos Stafylakis +3

Recently, fine-tuning large pre-trained Transformer models using downstream datasets has received a rising interest. Despite their success, it is still challenging to disentangle t…