Robust Acoustic Domain Identification with its Application to Speaker Diarization

Abstract

With the rise in multimedia content over the years, more variety is observed in the recording environments of audio. An audio processing system might benefit when it has a module to identify the acoustic domain at its front-end. In this paper, we demonstrate the idea of \emph{acoustic domain identification} (ADI) for \emph{speaker diarization}. For this, we first present a detailed study of the various domains of the third DIHARD challenge highlighting the factors that differentiated them from each other. Our main contribution is to develop a simple and efficient solution for ADI. In the present work, we explore speaker embeddings for this task. Next, we integrate the ADI module with the speaker diarization framework of the DIHARD III challenge. The performance substantially improved over that of the baseline when the thresholds for agglomerative hierarchical clustering were optimized according to the respective domains. We achieved a relative improvement of more than $5\%$ and $8\%$ in DER for core and full conditions, respectively, on Track 1 of the DIHARD III evaluation set.

arXiv commentAccepted for publication in International Journal of Speech Technology (Springer Nature)

References in corpus (9)

• VoxCeleb2: Deep Speaker Recognition
• VoxCeleb: a large-scale speaker identification dataset
• Acoustic Scene Classification
• A multi-device dataset for urban acoustic scene classification
• Integrating the Data Augmentation Scheme with Various Classifiers for Acoustic Scene Modeling
• Probing the Information Encoded in X-vectors
• Convolutional Neural Networks and x-vector Embedding for DCASE2018 Acoustic Scene Classification Challenge
• Acoustic scene classification in DCASE 2020 Challenge: generalization across devices and low complexity solutions
• USTC-NELSLIP System Description for DIHARD-III Challenge