The VoxCeleb Speaker Recognition Challenge: A Retrospective
arXiv:2408.14886 · doi:10.1109/TASLP.2024.3444456
Abstract
The VoxCeleb Speaker Recognition Challenges (VoxSRC) were a series of challenges and workshops that ran annually from 2019 to 2023. The challenges primarily evaluated the tasks of speaker recognition and diarisation under various settings including: closed and open training data; as well as supervised, self-supervised, and semi-supervised training for domain adaptation. The challenges also provided publicly available training and evaluation datasets for each task and setting, with new test sets released each year. In this paper, we provide a review of these challenges that covers: what they explored; the methods developed by the challenge participants and how these evolved; and also the current state of the field for speaker verification and diarisation. We chart the progress in performance over the five installments of the challenge on a common evaluation dataset and provide a detailed analysis of how each year's special focus affected participants' performance. This paper is aimed both at researchers who want an overview of the speaker recognition and diarisation field, and also at challenge organisers who want to benefit from the successes and avoid the mistakes of the VoxSRC challenges. We end with a discussion of the current strengths of the field and open challenges. Project page : https://mm.kaist.ac.kr/datasets/voxceleb/voxsrc/workshop.html
TASLP 2024
References in corpus (17)
- LLaMA: Open and Efficient Foundation Language Models
- VoxSRC 2020: The Second VoxCeleb Speaker Recognition Challenge
- VoxSRC 2019: The first VoxCeleb Speaker Recognition Challenge
- EvalAI: Towards Better Evaluation Systems for AI Agents
- The SpeakIn System for VoxCeleb Speaker Recognition Challange 2021
- The VoxCeleb Speaker Recognition Challenge: A Retrospective
- The DKU-DukeECE-Lenovo System for the Diarization Task of the 2021 VoxCeleb Speaker Recognition Challenge
- The DKU-DukeECE System for the Self-Supervision Speaker Verification Task of the 2021 VoxCeleb Speaker Recognition Challenge
- The ByteDance Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2021
- The xx205 System for the VoxCeleb Speaker Recognition Challenge 2020
- The HCCL system for VoxCeleb Speaker Recognition Challenge 2022
- The DKU-Tencent System for the VoxCeleb Speaker Recognition Challenge 2022
- The Phonexia VoxCeleb Speaker Recognition Challenge 2021 System Description
- The Kriston AI System for the VoxCeleb Speaker Recognition Challenge 2022
- The DKU-DukeECE Diarization System for the VoxCeleb Speaker Recognition Challenge 2022
- The DKU-MSXF Speaker Verification System for the VoxCeleb Speaker Recognition Challenge 2023
- UNISOUND System for VoxCeleb Speaker Recognition Challenge 2023