openFEAT: Improving Speaker Identification by Open-set Few-shot Embedding Adaptation with Transformer

Abstract

Household speaker identification with few enrollment utterances is an important yet challenging problem, especially when household members share similar voice characteristics and room acoustics. A common embedding space learned from a large number of speakers is not universally applicable for the optimal identification of every speaker in a household. In this work, we first formulate household speaker identification as a few-shot open-set recognition task and then propose a novel embedding adaptation framework to adapt speaker representations from the given universal embedding space to a household-specific embedding space using a set-to-set function, yielding better household speaker identification performance. With our algorithm, Open-set Few-shot Embedding Adaptation with Transformer (openFEAT), we observe that the speaker identification equal error rate (IEER) on simulated households with 2 to 7 hard-to-discriminate speakers is reduced by 23% to 31% relative.

arXiv commentTo appear in Proc. IEEE ICASSP 2022

References in corpus (7)

• FaceNet: A Unified Embedding for Face Recognition and Clustering
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• VoxCeleb2: Deep Speaker Recognition
• VoxCeleb: a large-scale speaker identification dataset
• In defence of metric learning for speaker recognition
• Clova Baseline System for the VoxCeleb Speaker Recognition Challenge 2020

Cited by in corpus (2)

• Few-Shot Speaker Identification Using Lightweight Prototypical Network with Feature Grouping and Interaction
• Graph-based Multi-View Fusion and Local Adaptation: Mitigating Within-Household Confusability for Speaker Identification