Vision-based Learning for Drones: A Survey
arXiv:2312.05019 · doi:10.1109/TNNLS.2025.3564184
Abstract
Drones as advanced cyber-physical systems are undergoing a transformative shift with the advent of vision-based learning, a field that is rapidly gaining prominence due to its profound impact on drone autonomy and functionality. Different from existing task-specific surveys, this review offers a comprehensive overview of vision-based learning in drones, emphasizing its pivotal role in enhancing their operational capabilities under various scenarios. We start by elucidating the fundamental principles of vision-based learning, highlighting how it significantly improves drones' visual perception and decision-making processes. We then categorize vision-based control methods into indirect, semi-direct, and end-to-end approaches from the perception-control perspective. We further explore various applications of vision-based drones with learning capabilities, ranging from single-agent systems to more complex multi-agent and heterogeneous system scenarios, and underscore the challenges and innovations characterizing each area. Finally, we explore open questions and potential solutions, paving the way for ongoing research and development in this dynamic and rapidly evolving field. With growing large language models (LLMs) and embodied intelligence, vision-based learning for drones provides a promising but challenging road towards artificial general intelligence (AGI) in 3D physical world.
References in corpus (21)
- ORB-SLAM: a Versatile and Accurate Monocular SLAM System
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM
- Event-based Vision: A Survey
- Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlooks
- Deep Reinforcement Learning for Cyber Security
- Learning High-Speed Flight in the Wild
- A Survey on Deep Learning Techniques for Stereo-based Depth Estimation
- Cooperative Multi-Agent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control
- Fast, Autonomous Flight in GPS-Denied and Cluttered Environments
- CBNet: A Composite Backbone Network Architecture for Object Detection
- Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey
- Building an Aerial-Ground Robotics System for Precision Farming: An Adaptable Solution
- NeuroBEM: Hybrid Aerodynamic Quadrotor Model
- Distributed CNN Inference on Resource-Constrained UAVs for Surveillance Systems: Design and Optimization
- Collaborative Target Search with a Visual Drone Swarm: An Adaptive Curriculum Embedded Multistage Reinforcement Learning Approach
- Visual Model-predictive Localization for Computationally Efficient Autonomous Racing of a 72-gram Drone
- A Quadrotor with an Origami-Inspired Protective Mechanism
- Learning Multi-Pursuit Evasion for Safe Targeted Navigation of Drones
- Target Search and Navigation in Heterogeneous Robot Systems with Deep Reinforcement Learning
- Learning Resilient Formation Control of Drones with Graph Attention Network