Neuromorphic control for optic-flow-based landings of MAVs using the Loihi processor
arXiv:2011.00534 · doi:10.1109/ICRA48506.2021.9560937
Abstract
Neuromorphic processors like Loihi offer a promising alternative to conventional computing modules for endowing constrained systems like micro air vehicles (MAVs) with robust, efficient and autonomous skills such as take-off and landing, obstacle avoidance, and pursuit. However, a major challenge for using such processors on robotic platforms is the reality gap between simulation and the real world. In this study, we present for the very first time a fully embedded application of the Loihi neuromorphic chip prototype in a flying robot. A spiking neural network (SNN) was evolved to compute the thrust command based on the divergence of the ventral optic flow field to perform autonomous landing. Evolution was performed in a Python-based simulator using the PySNN library. The resulting network architecture consists of only 35 neurons distributed among 3 layers. Quantitative analysis between simulation and Loihi reveals a root-mean-square error of the thrust setpoint as low as 0.005 g, along with a 99.8% matching of the spike sequences in the hidden layer, and 99.7% in the output layer. The proposed approach successfully bridges the reality gap, offering important insights for future neuromorphic applications in robotics. Supplementary material is available at https://mavlab.tudelft.nl/loihi/.
References in corpus (4)
- Event-based Vision: A Survey
- Evolved Neuromorphic Control for High Speed Divergence-based Landings of MAVs
- Evolution of Robust High Speed Optical-Flow-Based Landing for Autonomous MAVs
- Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware
Cited by in corpus (4)
- Agilicious: Open-Source and Open-Hardware Agile Quadrotor for Vision-Based Flight
- Applications of Spiking Neural Networks in Visual Place Recognition
- Neuromorphic computing for attitude estimation onboard quadrotors
- Enabling Efficient Processing of Spiking Neural Networks with On-Chip Learning on Commodity Neuromorphic Processors for Edge AI Systems