A Review on Deep Learning in UAV Remote Sensing

Abstract

Deep Neural Networks (DNNs) learn representation from data with an impressive capability, and brought important breakthroughs for processing images, time-series, natural language, audio, video, and many others. In the remote sensing field, surveys and literature revisions specifically involving DNNs algorithms' applications have been conducted in an attempt to summarize the amount of information produced in its subfields. Recently, Unmanned Aerial Vehicles (UAV) based applications have dominated aerial sensing research. However, a literature revision that combines both "deep learning" and "UAV remote sensing" thematics has not yet been conducted. The motivation for our work was to present a comprehensive review of the fundamentals of Deep Learning (DL) applied in UAV-based imagery. We focused mainly on describing classification and regression techniques used in recent applications with UAV-acquired data. For that, a total of 232 papers published in international scientific journal databases was examined. We gathered the published material and evaluated their characteristics regarding application, sensor, and technique used. We relate how DL presents promising results and has the potential for processing tasks associated with UAV-based image data. Lastly, we project future perspectives, commentating on prominent DL paths to be explored in the UAV remote sensing field. Our revision consists of a friendly-approach to introduce, commentate, and summarize the state-of-the-art in UAV-based image applications with DNNs algorithms in diverse subfields of remote sensing, grouping it in the environmental, urban, and agricultural contexts.

27 pages, 10 figures

References in corpus (39)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Deep Learning in Neural Networks: An Overview
• Distilling the Knowledge in a Neural Network
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Improving neural networks by preventing co-adaptation of feature detectors
• An overview of gradient descent optimization algorithms
• Res2Net: A New Multi-scale Backbone Architecture
• Deep learning in remote sensing: a review
• Remote Sensing Image Scene Classification: Benchmark and State of the Art
• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
• Deep Learning for Hyperspectral Image Classification: An Overview
• Neural Architecture Search: A Survey
• Learning deep representations by mutual information estimation and maximization
• A Survey on Object Detection in Optical Remote Sensing Images
• Activation Functions: Comparison of trends in Practice and Research for Deep Learning
• Deep Learning for Classification of Hyperspectral Data: A Comparative Review
• Learning Representations by Maximizing Mutual Information Across Views
• Recent Advances in Domain Adaptation for the Classification of Remote Sensing Data
• A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community
• Contrastive Multiview Coding
• Improving Semantic Segmentation of Aerial Images Using Patch-based Attention
• Multi-Task Learning with Deep Neural Networks: A Survey
• A Survey: Deep Learning for Hyperspectral Image Classification with Few Labeled Samples
• Detecting Mammals in UAV Images: Best Practices to address a substantially Imbalanced Dataset with Deep Learning
• A Comprehensive Analysis of Deep Regression
• Vine disease detection in UAV multispectral images with deep learning segmentation approach
• Land Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks
• MCUNet: Tiny Deep Learning on IoT Devices
• MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classification
• Unsupervised Domain Adaptation using Generative Adversarial Networks for Semantic Segmentation of Aerial Images
• A Survey on Methods and Theories of Quantized Neural Networks
• DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution
• A CNN Approach to Simultaneously Count Plants and Detect Plantation-Rows from UAV Imagery
• Dynamic Multi-Context Segmentation of Remote Sensing Images based on Convolutional Networks
• Semantic Segmentation of Remote Sensing Images with Sparse Annotations
• VarifocalNet: An IoU-aware Dense Object Detector
• Deep Learning of Sea Surface Temperature Patterns to Identify Ocean Extremes
• Embedded Development Boards for Edge-AI: A Comprehensive Report

Cited by in corpus (5)

• Deep Learning for UAV-based Object Detection and Tracking: A Survey
• LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images
• Land Classification in Satellite Images by Injecting Traditional Features to CNN Models
• Exploiting Digital Surface Models for Inferring Super-Resolution for Remotely Sensed Images
• Investigation of Factorized Optical Flows as Mid-Level Representations