WaveFake: A Data Set to Facilitate Audio Deepfake Detection
arXiv:2111.02813
Abstract
Deep generative modeling has the potential to cause significant harm to society. Recognizing this threat, a magnitude of research into detecting so-called "Deepfakes" has emerged. This research most often focuses on the image domain, while studies exploring generated audio signals have, so-far, been neglected. In this paper we make three key contributions to narrow this gap. First, we provide researchers with an introduction to common signal processing techniques used for analyzing audio signals. Second, we present a novel data set, for which we collected nine sample sets from five different network architectures, spanning two languages. Finally, we supply practitioners with two baseline models, adopted from the signal processing community, to facilitate further research in this area.
arXiv commentAccepted to NeurIPS 2021 (Benchmark and Dataset Track); Code: https://github.com/RUB-SysSec/WaveFake; Data: https://zenodo.org/record/5642694
Cited by in corpus (8)
- Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review
- UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization
- Open Challenges in Synthetic Speech Detection
- Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection
- MFAAN: Unveiling Audio Deepfakes with a Multi-Feature Authenticity Network
- Speech-Forensics: Towards Comprehensive Synthetic Speech Dataset Establishment and Analysis
- Gen-AI for User Safety: A Survey
- Seeing Isn't Believing: Addressing the Societal Impact of Deepfakes in Low-Tech Environments