Agilicious: Open-Source and Open-Hardware Agile Quadrotor for Vision-Based Flight
arXiv:2307.06100 · doi:10.1126/scirobotics.abl6259
Abstract
Autonomous, agile quadrotor flight raises fundamental challenges for robotics research in terms of perception, planning, learning, and control. A versatile and standardized platform is needed to accelerate research and let practitioners focus on the core problems. To this end, we present Agilicious, a co-designed hardware and software framework tailored to autonomous, agile quadrotor flight. It is completely open-source and open-hardware and supports both model-based and neural-network--based controllers. Also, it provides high thrust-to-weight and torque-to-inertia ratios for agility, onboard vision sensors, GPU-accelerated compute hardware for real-time perception and neural-network inference, a real-time flight controller, and a versatile software stack. In contrast to existing frameworks, Agilicious offers a unique combination of flexible software stack and high-performance hardware. We compare Agilicious with prior works and demonstrate it on different agile tasks, using both model-based and neural-network--based controllers. Our demonstrators include trajectory tracking at up to 5g and 70 km/h in a motion-capture system, and vision-based acrobatic flight and obstacle avoidance in both structured and unstructured environments using solely onboard perception. Finally, we demonstrate its use for hardware-in-the-loop simulation in virtual-reality environments. Thanks to its versatility, we believe that Agilicious supports the next generation of scientific and industrial quadrotor research.
arXiv comment14 pages, 5 figures, 2 tables
References in corpus (21)
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- Event-based Vision: A Survey
- A scalable multi-core architecture with heterogeneous memory structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs)
- Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning
- Differential Flatness of Quadrotor Dynamics Subject to Rotor Drag for Accurate Tracking of High-Speed Trajectories
- Learning High-Speed Flight in the Wild
- Time-Optimal Planning for Quadrotor Waypoint Flight
- Fast, Autonomous Flight in GPS-Denied and Cluttered Environments
- A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones
- Aggressive Quadrotor Flight through Narrow Gaps with Onboard Sensing and Computing using Active Vision
- The MRS UAV System: Pushing the Frontiers of Reproducible Research, Real-world Deployment, and Education with Autonomous Unmanned Aerial Vehicles
- FlightGoggles: A Modular Framework for Photorealistic Camera, Exteroceptive Sensor, and Dynamics Simulation
- NeuroBEM: Hybrid Aerodynamic Quadrotor Model
- Autonomous Quadrotor Flight despite Rotor Failure with Onboard Vision Sensors: Frames vs. Events
- An Open-Source System for Vision-Based Micro-Aerial Vehicle Mapping, Planning, and Flight in Cluttered Environments
- Autonomous drone race: A computationally efficient vision-based navigation and control strategy
- Neuromorphic control for optic-flow-based landings of MAVs using the Loihi processor
- An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVs
- Build Your Own Visual-Inertial Drone: A Cost-Effective and Open-Source Autonomous Drone
- Combining Optimal Control and Learning for Visual Navigation in Novel Environments
Cited by in corpus (23)
- Reaching the Limit in Autonomous Racing: Optimal Control versus Reinforcement Learning
- Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms
- Autonomous Drone Racing: A Survey
- Adaptive formation motion planning and control of autonomous underwater vehicles using deep reinforcement learning
- Learning Minimum-Time Flight in Cluttered Environments
- Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control
- Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physics
- MRS Drone: A Modular Platform for Real-World Deployment of Aerial Multi-Robot Systems
- Optimality Principles in Spacecraft Neural Guidance and Control
- Survey of Simulators for Aerial Robots: An Overview and In-Depth Systematic Comparisons
- Agile and Cooperative Aerial Manipulation of a Cable-Suspended Load
- A Heterogeneous RISC-V based SoC for Secure Nano-UAV Navigation
- Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs
- Race Against the Machine: a Fully-annotated, Open-design Dataset of Autonomous and Piloted High-speed Flight
- Autonomous Marker-less Rapid Aerial Grasping
- A Small Form Factor Aerial Research Vehicle for Pick-and-Place Tasks with Onboard Real-Time Object Detection and Visual Odometry
- Time-Optimal Online Replanning for Agile Quadrotor Flight
- Scalable Outdoors Autonomous Drone Flight with Visual-Inertial SLAM and Dense Submaps Built without LiDAR
- On Your Own: Pro-level Autonomous Drone Racing in Uninstrumented Arenas
- Low-Latency Event-Based Velocimetry for Quadrotor Control in a Narrow Pipe
- LoL-NMPC: Low-Level Dynamics Integration in Nonlinear Model Predictive Control for Unmanned Aerial Vehicles
- SPIRAL: Self-Play Incremental Racing Algorithm for Learning in Multi-Drone Competitions
- SMapper: A Multi-Modal Data Acquisition Platform for SLAM Benchmarking