Image Forgery Localization Based on Multi-Scale Convolutional Neural Networks

Abstract

In this paper, we propose to utilize Convolutional Neural Networks (CNNs) and the segmentation-based multi-scale analysis to locate tampered areas in digital images. First, to deal with color input sliding windows of different scales, a unified CNN architecture is designed. Then, we elaborately design the training procedures of CNNs on sampled training patches. With a set of robust multi-scale tampering detectors based on CNNs, complementary tampering possibility maps can be generated. Last but not least, a segmentation-based method is proposed to fuse the maps and generate the final decision map. By exploiting the benefits of both the small-scale and large-scale analyses, the segmentation-based multi-scale analysis can lead to a performance leap in forgery localization of CNNs. Numerous experiments are conducted to demonstrate the effectiveness and efficiency of our method.

7 pages, 6 figures

References in corpus (8)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• How transferable are features in deep neural networks?
• AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classification
• ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
• Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
• Land Use Classification in Remote Sensing Images by Convolutional Neural Networks
• Adaptive Deep Pyramid Matching for Remote Sensing Scene Classification
• Learning Multi-Scale Deep Features for High-Resolution Satellite Image Classification

Cited by in corpus (5)

• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• Building Damage Annotation on Post-Hurricane Satellite Imagery Based on Convolutional Neural Networks
• MGML: Multi-Granularity Multi-Level Feature Ensemble Network for Remote Sensing Scene Classification
• Domain Adaptive Transfer Attack (DATA)-based Segmentation Networks for Building Extraction from Aerial Images
• Short-term prediction of Electricity Outages Caused by Convective Storms