Cross-Lingual Speaker Verification with Domain-Balanced Hard Prototype Mining and Language-Dependent Score Normalization

Abstract

In this paper we describe the top-scoring IDLab submission for the text-independent task of the Short-duration Speaker Verification (SdSV) Challenge 2020. The main difficulty of the challenge exists in the large degree of varying phonetic overlap between the potentially cross-lingual trials, along with the limited availability of in-domain DeepMine Farsi training data. We introduce domain-balanced hard prototype mining to fine-tune the state-of-the-art ECAPA-TDNN x-vector based speaker embedding extractor. The sample mining technique efficiently exploits speaker distances between the speaker prototypes of the popular AAM-softmax loss function to construct challenging training batches that are balanced on the domain-level. To enhance the scoring of cross-lingual trials, we propose a language-dependent s-norm score normalization. The imposter cohort only contains data from the Farsi target-domain which simulates the enrollment data always being Farsi. In case a Gaussian-Backend language model detects the test speaker embedding to contain English, a cross-language compensation offset determined on the AAM-softmax speaker prototypes is subtracted from the maximum expected imposter mean score. A fusion of five systems with minor topological tweaks resulted in a final MinDCF and EER of 0.065 and 1.45% respectively on the SdSVC evaluation set.

proceedings of INTERSPEECH 2020

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Prototypical Networks for Few-shot Learning
• SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
• Res2Net: A New Multi-scale Backbone Architecture
• VoxCeleb2: Deep Speaker Recognition
• Squeeze-and-Excitation Networks
• VoxCeleb: a large-scale speaker identification dataset
• ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
• In defence of metric learning for speaker recognition
• The BOSARIS Toolkit: Theory, Algorithms and Code for Surviving the New DCF
• Short-duration Speaker Verification (SdSV) Challenge 2021: the Challenge Evaluation Plan

Cited by in corpus (5)

• ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
• ECAPA-TDNN Embeddings for Speaker Diarization
• Integrating Frequency Translational Invariance in TDNNs and Frequency Positional Information in 2D ResNets to Enhance Speaker Verification
• The IDLAB VoxSRC-20 Submission: Large Margin Fine-Tuning and Quality-Aware Score Calibration in DNN Based Speaker Verification
• The IDLAB VoxCeleb Speaker Recognition Challenge 2020 System Description