Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation

Abstract

In appearance-based localization and mapping, loop closure detection is the process used to determinate if the current observation comes from a previously visited location or a new one. As the size of the internal map increases, so does the time required to compare new observations with all stored locations, eventually limiting online processing. This paper presents an online loop closure detection approach for large-scale and long-term operation. The approach is based on a memory management method, which limits the number of locations used for loop closure detection so that the computation time remains under real-time constraints. The idea consists of keeping the most recent and frequently observed locations in a Working Memory (WM) used for loop closure detection, and transferring the others into a Long-Term Memory (LTM). When a match is found between the current location and one stored in WM, associated locations stored in LTM can be updated and remembered for additional loop closure detections. Results demonstrate the approach's adaptability and scalability using ten standard data sets from other appearance-based loop closure approaches, one custom data set using real images taken over a 2 km loop of our university campus, and one custom data set (7 hours) using virtual images from the racing video game ``Need for Speed: Most Wanted''.

12 pages, 11 figures

References in corpus (1)

• Memory Management for Real-Time Appearance-Based Loop Closure Detection

Cited by in corpus (22)

• RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operation
• Online Global Loop Closure Detection for Large-Scale Multi-Session Graph-Based SLAM
• The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection
• iBoW-LCD: An Appearance-based Loop Closure Detection Approach using Incremental Bags of Binary Words
• Long-Term Online Multi-Session Graph-Based SPLAM with Memory Management
• Visual-Thermal Landmarks and Inertial Fusion for Navigation in Degraded Visual Environments
• Real-time 3D Reconstruction on Construction Site using Visual SLAM and UAV
• Spiking Neural Networks for Visual Place Recognition via Weighted Neuronal Assignments
• Multi-Session Visual SLAM for Illumination Invariant Re-Localization in Indoor Environments
• Frontier Semantic Exploration for Visual Target Navigation
• Augmenting Visual SLAM with Wi-Fi Sensing For Indoor Applications
• Cheap or Robust? The Practical Realization of Self-Driving Wheelchair Technology
• Sensor Fusion for Autonomous Indoor UAV Navigation in Confined Spaces
• Multiple Hypothesis Semantic Mapping for Robust Data Association
• Vision-Depth Landmarks and Inertial Fusion for Navigation in Degraded Visual Environments
• Learning Whole-Image Descriptors for Real-time Loop Detection andKidnap Recovery under Large Viewpoint Difference
• DualQuat-LOAM: LiDAR Odometry and Mapping parametrized on Dual Quaternions
• Combining Geometric and Information-Theoretic Approaches for Multi-Robot Exploration
• Transfer Learning-Based Crack Detection by Autonomous UAVs
• Sequence-based Multimodal Apprenticeship Learning For Robot Perception and Decision Making
• S2P2: Self-Supervised Goal-Directed Path Planning Using RGB-D Data for Robotic Wheelchairs
• Beyond SIFT using Binary features for Loop Closure Detection