Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)
arXiv:1709.02016 · doi:10.1016/j.jvcir.2018.01.010
Abstract
In this work, we propose a technique that utilizes a fully convolutional network (FCN) to localize image splicing attacks. We first evaluated a single-task FCN (SFCN) trained only on the surface label. Although the SFCN is shown to provide superior performance over existing methods, it still provides a coarse localization output in certain cases. Therefore, we propose the use of a multi-task FCN (MFCN) that utilizes two output branches for multi-task learning. One branch is used to learn the surface label, while the other branch is used to learn the edge or boundary of the spliced region. We trained the networks using the CASIA v2.0 dataset, and tested the trained models on the CASIA v1.0, Columbia Uncompressed, Carvalho, and the DARPA/NIST Nimble Challenge 2016 SCI datasets. Experiments show that the SFCN and MFCN outperform existing splicing localization algorithms, and that the MFCN can achieve finer localization than the SFCN.
This manuscript was submitted for publication
References in corpus (1)
Cited by in corpus (29)
- Media Forensics and DeepFakes: an overview
- MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection
- SPAN: Spatial Pyramid Attention Network forImage Manipulation Localization
- ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection
- Self-Adversarial Training incorporating Forgery Attention for Image Forgery Localization
- Learning Rich Features for Image Manipulation Detection
- One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework
- Exposing Fake Images with Forensic Similarity Graphs
- CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation
- Object Discovery with a Copy-Pasting GAN
- Making Images Real Again: A Comprehensive Survey on Deep Image Composition
- D-Unet: A Dual-encoder U-Net for Image Splicing Forgery Detection and Localization
- Face X-ray for More General Face Forgery Detection
- A Convolutional LSTM based Residual Network for Deepfake Video Detection
- SpliceRadar: A Learned Method For Blind Image Forensics
- Generate, Segment and Refine: Towards Generic Manipulation Segmentation
- Deep Video Inpainting Detection
- Seam Carving Detection and Localization using Two-Stage Deep Neural Networks
- Perceptually Motivated Method for Image Inpainting Comparison
- TBNet:Two-Stream Boundary-aware Network for Generic Image Manipulation Localization
- FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning
- Constrained R-CNN: A general image manipulation detection model
- Efficient Object Embedding for Spliced Image Retrieval
- Fighting Fake News: Image Splice Detection via Learned Self-Consistency
- Metric Learning for Anti-Compression Facial Forgery Detection
- Efficient Image Splicing Localization via Contrastive Feature Extraction
- Detecting and Segmenting Adversarial Graphics Patterns from Images
- Analysing Statistical methods for Automatic Detection of Image Forgery
- Adversarial Attack on Deep Learning-Based Splice Localization