The DeepFake Detection Challenge (DFDC) Dataset
arXiv:2006.07397
Abstract
Deepfakes are a recent off-the-shelf manipulation technique that allows anyone to swap two identities in a single video. In addition to Deepfakes, a variety of GAN-based face swapping methods have also been published with accompanying code. To counter this emerging threat, we have constructed an extremely large face swap video dataset to enable the training of detection models, and organized the accompanying DeepFake Detection Challenge (DFDC) Kaggle competition. Importantly, all recorded subjects agreed to participate in and have their likenesses modified during the construction of the face-swapped dataset. The DFDC dataset is by far the largest currently and publicly available face swap video dataset, with over 100,000 total clips sourced from 3,426 paid actors, produced with several Deepfake, GAN-based, and non-learned methods. In addition to describing the methods used to construct the dataset, we provide a detailed analysis of the top submissions from the Kaggle contest. We show although Deepfake detection is extremely difficult and still an unsolved problem, a Deepfake detection model trained only on the DFDC can generalize to real "in-the-wild" Deepfake videos, and such a model can be a valuable analysis tool when analyzing potentially Deepfaked videos. Training, validation and testing corpuses can be downloaded from https://ai.facebook.com/datasets/dfdc.
References in corpus (7)
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
- mixup: Beyond Empirical Risk Minimization
- Media Forensics and DeepFakes: an overview
- DeepFakes: a New Threat to Face Recognition? Assessment and Detection
- The Deepfake Detection Challenge (DFDC) Preview Dataset
- Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics
- See Better Before Looking Closer: Weakly Supervised Data Augmentation Network for Fine-Grained Visual Classification
Cited by in corpus (14)
- Combining EfficientNet and Vision Transformers for Video Deepfake Detection
- Deepfake Detection Scheme Based on Vision Transformer and Distillation
- FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset
- Multi-attentional Deepfake Detection
- Adversarially robust deepfake media detection using fused convolutional neural network predictions
- FaceGuard: Proactive Deepfake Detection
- KoDF: A Large-scale Korean DeepFake Detection Dataset
- DeeperForensics Challenge 2020 on Real-World Face Forgery Detection: Methods and Results
- The Deepfake Detection Dilemma: A Multistakeholder Exploration of Adversarial Dynamics in Synthetic Media
- DeepFake MNIST+: A DeepFake Facial Animation Dataset
- Video Transformer for Deepfake Detection with Incremental Learning
- Impact of Benign Modifications on Discriminative Performance of Deepfake Detectors
- DeepFake Detection with Inconsistent Head Poses: Reproducibility and Analysis
- Does Melania Trump have a body double from the perspective of automatic face recognition?