Aggressive Quadrotor Flight through Narrow Gaps with Onboard Sensing and Computing using Active Vision

Abstract

We address one of the main challenges towards autonomous quadrotor flight in complex environments, which is flight through narrow gaps. While previous works relied on off-board localization systems or on accurate prior knowledge of the gap position and orientation, we rely solely on onboard sensing and computing and estimate the full state by fusing gap detection from a single onboard camera with an IMU. This problem is challenging for two reasons: (i) the quadrotor pose uncertainty with respect to the gap increases quadratically with the distance from the gap; (ii) the quadrotor has to actively control its orientation towards the gap to enable state estimation (i.e., active vision). We solve this problem by generating a trajectory that considers geometric, dynamic, and perception constraints: during the approach maneuver, the quadrotor always faces the gap to allow state estimation, while respecting the vehicle dynamics; during the traverse through the gap, the distance of the quadrotor to the edges of the gap is maximized. Furthermore, we replan the trajectory during its execution to cope with the varying uncertainty of the state estimate. We successfully evaluate and demonstrate the proposed approach in many real experiments. To the best of our knowledge, this is the first work that addresses and achieves autonomous, aggressive flight through narrow gaps using only onboard sensing and computing and without prior knowledge of the pose of the gap.

Cited by in corpus (22)

• Deep Drone Racing: From Simulation to Reality with Domain Randomization
• A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones
• Agilicious: Open-Source and Open-Hardware Agile Quadrotor for Vision-Based Flight
• Autonomous Drone Racing: A Survey
• Fast Autonomous Flight in Warehouses for Inventory Applications
• GapFlyt: Active Vision Based Minimalist Structure-less Gap Detection For Quadrotor Flight
• Autonomous drone race: A computationally efficient vision-based navigation and control strategy
• Visual Model-predictive Localization for Computationally Efficient Autonomous Racing of a 72-gram Drone
• Reconfigurable Drone System for Transportation of Parcels With Variable Mass and Size
• Design and Control of SQUEEZE: A Spring-augmented QUadrotor for intEractions with the Environment to squeeZE-and-fly
• Collaborative Multi-Robot Systems for Search and Rescue: Coordination and Perception
• Deep Drone Racing: Learning Agile Flight in Dynamic Environments
• Interleaving Graph Search and Trajectory Optimization for Aggressive Quadrotor Flight
• The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competition
• Joint Vision-Based Navigation, Control and Obstacle Avoidance for UAVs in Dynamic Environments
• Effective Target Aware Visual Navigation for UAVs
• Multicopter attitude control for recovery from large disturbances
• Fast-Racing: An Open-source Strong Baseline for SE(3) Planning in Autonomous Drone Racing
• Flying Through a Narrow Gap Using End-to-end Deep Reinforcement Learning Augmented with Curriculum Learning and Sim2Real
• Mapless Navigation: Learning UAVs Motion forExploration of Unknown Environments
• Active Perception with Neural Networks
• Quadrotor going through a window and landing: An image-based visual servo control approach