Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
arXiv:2007.08494 · doi:10.1016/j.isprsjprs.2020.06.016
Abstract
Vehicle detection in remote sensing images has attracted increasing interest in recent years. However, its detection ability is limited due to lack of well-annotated samples, especially in densely crowded scenes. Furthermore, since a list of remotely sensed data sources is available, efficient exploitation of useful information from multi-source data for better vehicle detection is challenging. To solve the above issues, a multi-source active fine-tuning vehicle detection (Ms-AFt) framework is proposed, which integrates transfer learning, segmentation, and active classification into a unified framework for auto-labeling and detection. The proposed Ms-AFt employs a fine-tuning network to firstly generate a vehicle training set from an unlabeled dataset. To cope with the diversity of vehicle categories, a multi-source based segmentation branch is then designed to construct additional candidate object sets. The separation of high quality vehicles is realized by a designed attentive classifications network. Finally, all three branches are combined to achieve vehicle detection. Extensive experimental results conducted on two open ISPRS benchmark datasets, namely the Vaihingen village and Potsdam city datasets, demonstrate the superiority and effectiveness of the proposed Ms-AFt for vehicle detection. In addition, the generalization ability of Ms-AFt in dense remote sensing scenes is further verified on stereo aerial imagery of a large camping site.
References in corpus (16)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- R-FCN: Object Detection via Region-based Fully Convolutional Networks
- Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark
- A Survey on Object Detection in Optical Remote Sensing Images
- An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
- Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
- Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
- Learnable Manifold Alignment (LeMA) : A Semi-supervised Cross-modality Learning Framework for Land Cover and Land Use Classification
- MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classification
- CoSpace: Common Subspace Learning from Hyperspectral-Multispectral Correspondences
- ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features
- Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection
- AVDNet: A Small-Sized Vehicle Detection Network for Aerial Visual Data
- Learning Convolutional Sparse Coding on Complex Domain for Interferometric Phase Restoration
- Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matching
- Multisource Region Attention Network for Fine-Grained Object Recognition in Remote Sensing Imagery