On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances and Million-AID

Abstract

The past years have witnessed great progress on remote sensing (RS) image interpretation and its wide applications. With RS images becoming more accessible than ever before, there is an increasing demand for the automatic interpretation of these images. In this context, the benchmark datasets serve as essential prerequisites for developing and testing intelligent interpretation algorithms. After reviewing existing benchmark datasets in the research community of RS image interpretation, this article discusses the problem of how to efficiently prepare a suitable benchmark dataset for RS image interpretation. Specifically, we first analyze the current challenges of developing intelligent algorithms for RS image interpretation with bibliometric investigations. We then present the general guidances on creating benchmark datasets in efficient manners. Following the presented guidances, we also provide an example on building RS image dataset, i.e., Million-AID, a new large-scale benchmark dataset containing a million instances for RS image scene classification. Several challenges and perspectives in RS image annotation are finally discussed to facilitate the research in benchmark dataset construction. We do hope this paper will provide the RS community an overall perspective on constructing large-scale and practical image datasets for further research, especially data-driven ones.

References in corpus (24)

• Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark
• Graph Convolutional Networks for Hyperspectral Image Classification
• A Survey on Object Detection in Optical Remote Sensing Images
• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images
• Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Models
• Gliding vertex on the horizontal bounding box for multi-oriented object detection
• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• Towards Better Exploiting Convolutional Neural Networks for Remote Sensing Scene Classification
• Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
• Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
• Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery using Deep Learning
• PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrieval
• Object Detection in 20 Years: A Survey
• A survey of active learning algorithms for supervised remote sensing image classification
• BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understanding
• Vision Meets Drones: A Challenge
• Binary Patterns Encoded Convolutional Neural Networks for Texture Recognition and Remote Sensing Scene Classification
• Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Data
• xView: Objects in Context in Overhead Imagery
• So2Sat LCZ42: A Benchmark Dataset for Global Local Climate Zones Classification
• Hi-UCD: A Large-scale Dataset for Urban Semantic Change Detection in Remote Sensing Imagery
• Texture Characterization by Using Shape Co-occurrence Patterns
• Hierarchical Bayesian image analysis: from low-level modeling to robust supervised learning