Neuromorphic Perception and Navigation for Mobile Robots: A Review

Abstract

With the fast and unstoppable evolution of robotics and artificial intelligence, effective autonomous navigation in real-world scenarios has become one of the most pressing challenges in the literature. However, demanding requirements, such as real-time operation, energy and computational efficiency, robustness, and reliability, make most current solutions unsuitable for real-world challenges. Thus, researchers are forced to seek innovative approaches, such as bio-inspired solutions. Indeed, animals have the intrinsic ability to efficiently perceive, understand, and navigate their unstructured surroundings. To do so, they exploit self-motion cues, proprioception, and visual flow in a cognitive process to map their environment and locate themselves within it. Computational neuroscientists aim to answer ''how'' and ''why'' such cognitive processes occur in the brain, to design novel neuromorphic sensors and methods that imitate biological processing. This survey aims to comprehensively review the application of brain-inspired strategies to autonomous navigation, considering: neuromorphic perception and asynchronous event processing, energy-efficient and adaptive learning, or the imitation of the working principles of brain areas that play a crucial role in navigation such as the hippocampus or the entorhinal cortex.

35 pages, 6 figures, journal article

References in corpus (27)

• Event-based Vision: A Survey
• Faster and better: a machine learning approach to corner detection
• Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning
• The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
• EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Cameras
• Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
• Event-based Moving Object Detection and Tracking
• A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation
• Time-Optimal Planning for Quadrotor Waypoint Flight
• Event-based, 6-DOF Camera Tracking from Photometric Depth Maps
• The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection
• Semi-Dense 3D Reconstruction with a Stereo Event Camera
• VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM
• DDD17: End-To-End DAVIS Driving Dataset
• Secrets of Event-Based Optical Flow
• PANTHER: Perception-Aware Trajectory Planner in Dynamic Environments
• Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networks
• StereoSpike: Depth Learning with a Spiking Neural Network
• Multi-Event-Camera Depth Estimation and Outlier Rejection by Refocused Events Fusion
• EM-driven unsupervised learning for efficient motion segmentation
• Night vision obstacle detection and avoidance based on Bio-Inspired Vision Sensors
• EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithms
• Task Planning in Robotics: an Empirical Comparison of PDDL-based and ASP-based Systems
• Real-time high speed motion prediction using fast aperture-robust event-driven visual flow
• Adaptive-SpikeNet: Event-based Optical Flow Estimation using Spiking Neural Networks with Learnable Neuronal Dynamics
• SpikeMS: Deep Spiking Neural Network for Motion Segmentation
• Spiking Optical Flow for Event-based Sensors Using IBM's TrueNorth Neurosynaptic System