Remote Sensor Design for Visual Recognition with Convolutional Neural Networks
arXiv:1906.09677 · doi:10.1109/TGRS.2019.2925813
Abstract
While deep learning technologies for computer vision have developed rapidly since 2012, modeling of remote sensing systems has remained focused around human vision. In particular, remote sensing systems are usually constructed to optimize sensing cost-quality trade-offs with respect to human image interpretability. While some recent studies have explored remote sensing system design as a function of simple computer vision algorithm performance, there has been little work relating this design to the state-of-the-art in computer vision: deep learning with convolutional neural networks. We develop experimental systems to conduct this analysis, showing results with modern deep learning algorithms and recent overhead image data. Our results are compared to standard image quality measurements based on human visual perception, and we conclude not only that machine and human interpretability differ significantly, but that computer vision performance is largely self-consistent across a range of disparate conditions. This research is presented as a cornerstone for a new generation of sensor design systems which focus on computer algorithm performance instead of human visual perception.
arXiv commentAccepted for publication in IEEE Transactions on Geoscience and Remote Sensing
References in corpus (10)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- FaceNet: A Unified Embedding for Face Recognition and Clustering
- SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
- Deep learning in remote sensing: a review
- Striving for Simplicity: The All Convolutional Net
- Scalable Bayesian Optimization Using Deep Neural Networks
- SpaceNet: A Remote Sensing Dataset and Challenge Series
- Hydra: an Ensemble of Convolutional Neural Networks for Geospatial Land Classification
- xView: Objects in Context in Overhead Imagery
- Exploiting Deep Features for Remote Sensing Image Retrieval: A Systematic Investigation