AirLoop: Lifelong Loop Closure Detection
arXiv:2109.08975 · doi:10.1109/ICRA46639.2022.9811658
Abstract
Loop closure detection is an important building block that ensures the accuracy and robustness of simultaneous localization and mapping (SLAM) systems. Due to their generalization ability, CNN-based approaches have received increasing attention. Although they normally benefit from training on datasets that are diverse and reflective of the environments, new environments often emerge after the model is deployed. It is therefore desirable to incorporate the data newly collected during operation for incremental learning. Nevertheless, simply finetuning the model on new data is infeasible since it may cause the model's performance on previously learned data to degrade over time, which is also known as the problem of catastrophic forgetting. In this paper, we present AirLoop, a method that leverages techniques from lifelong learning to minimize forgetting when training loop closure detection models incrementally. We experimentally demonstrate the effectiveness of AirLoop on TartanAir, Nordland, and RobotCar datasets. To the best of our knowledge, AirLoop is one of the first works to achieve lifelong learning of deep loop closure detectors.
References in corpus (19)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- FaceNet: A Unified Embedding for Face Recognition and Clustering
- Overcoming catastrophic forgetting in neural networks
- A continual learning survey: Defying forgetting in classification tasks
- Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
- Continual Learning Through Synaptic Intelligence
- Gradient Episodic Memory for Continual Learning
- Experience Replay for Continual Learning
- Encoder Based Lifelong Learning
- Continual Learning with Deep Generative Replay
- iBoW-LCD: An Appearance-based Loop Closure Detection Approach using Incremental Bags of Binary Words
- Reference Pose Generation for Long-term Visual Localization via Learned Features and View Synthesis
- Where is your place, Visual Place Recognition?
- Single-View Place Recognition under Seasonal Changes
- Pseudo-Recursal: Solving the Catastrophic Forgetting Problem in Deep Neural Networks
- Unsupervised Online Learning for Robotic Interestingness with Visual Memory
- On the Exploration of Incremental Learning for Fine-grained Image Retrieval
- Lifelong Graph Learning
- Fast and Incremental Loop Closure Detection with Deep Features and Proximity Graphs