Evolved Neuromorphic Control for High Speed Divergence-based Landings of MAVs

Abstract

Flying insects are capable of vision-based navigation in cluttered environments, reliably avoiding obstacles through fast and agile maneuvers, while being very efficient in the processing of visual stimuli. Meanwhile, autonomous micro air vehicles still lag far behind their biological counterparts, displaying inferior performance at a much higher energy consumption. In light of this, we want to mimic flying insects in terms of their processing capabilities, and consequently show the efficiency of this approach in the real world. This letter does so through evolving spiking neural networks for controlling landings of micro air vehicles using optical flow divergence from a downward-looking camera. We demonstrate that the resulting neuromorphic controllers transfer robustly from a highly abstracted simulation to the real world, performing fast and safe landings while keeping network spike rate minimal. Furthermore, we provide insight into the resources required for successfully solving the problem of divergence-based landing, showing that high-resolution control can be learned with only a single spiking neuron. To the best of our knowledge, this work is the first to integrate spiking neural networks in the control loop of a real-world flying robot. Videos of the experiments can be found at https://bit.ly/neuro-controller .

arXiv comment8 pages, 6 figures, camera-ready version to appear in IEEE Robotics and Automation Letters

References in corpus (7)

• Event-based Vision: A Survey
• Deep Learning in Spiking Neural Networks
• Control of a Quadrotor with Reinforcement Learning
• Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception
• Indirect and Direct Training of Spiking Neural Networks for End-to-End Control of a Lane-Keeping Vehicle
• Vertical Landing for Micro Air Vehicles using Event-Based Optical Flow
• Evolution of Robust High Speed Optical-Flow-Based Landing for Autonomous MAVs

Cited by in corpus (2)

• Neural Network-based Flight Control Systems: Present and Future
• Neuromorphic control for optic-flow-based landings of MAVs using the Loihi processor