Evaluating Voice Conversion-based Privacy Protection against Informed Attackers
arXiv:1911.03934
Abstract
Speech data conveys sensitive speaker attributes like identity or accent. With a small amount of found data, such attributes can be inferred and exploited for malicious purposes: voice cloning, spoofing, etc. Anonymization aims to make the data unlinkable, i.e., ensure that no utterance can be linked to its original speaker. In this paper, we investigate anonymization methods based on voice conversion. In contrast to prior work, we argue that various linkage attacks can be designed depending on the attackers' knowledge about the anonymization scheme. We compare two frequency warping-based conversion methods and a deep learning based method in three attack scenarios. The utility of converted speech is measured via the word error rate achieved by automatic speech recognition, while privacy protection is assessed by the increase in equal error rate achieved by state-of-the-art i-vector or x-vector based speaker verification. Our results show that voice conversion schemes are unable to effectively protect against an attacker that has extensive knowledge of the type of conversion and how it has been applied, but may provide some protection against less knowledgeable attackers.
References in corpus (1)
Cited by in corpus (18)
- The VoicePrivacy 2020 Challenge: Results and findings
- Introducing the VoicePrivacy Initiative
- Augmented Datasheets for Speech Datasets and Ethical Decision-Making
- An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learning
- The VoicePrivacy 2020 Challenge Evaluation Plan
- The Impact of Speech Anonymization on Pathology and Its Limits
- A False Sense of Privacy: Towards a Reliable Evaluation Methodology for the Anonymization of Biometric Data
- Introducing Model Inversion Attacks on Automatic Speaker Recognition
- StarGAN-ZSVC: Towards Zero-Shot Voice Conversion in Low-Resource Contexts
- On the Impact of Voice Anonymization on Speech Diagnostic Applications: a Case Study on COVID-19 Detection
- Evaluation of Speaker Anonymization on Emotional Speech
- Privacy-Protecting Techniques for Behavioral Biometric Data: A Survey
- A Study of F0 Modification for X-Vector Based Speech Pseudonymization Across Gender
- Quantifying Source Speaker Leakage in One-to-One Voice Conversion
- Speech Pseudonymisation Assessment Using Voice Similarity Matrices
- A Tandem Framework Balancing Privacy and Security for Voice User Interfaces
- Fantômas: Understanding Face Anonymization Reversibility
- When Automatic Voice Disguise Meets Automatic Speaker Verification