Where is your place, Visual Place Recognition?

Abstract

Visual Place Recognition (VPR) is often characterized as being able to recognize the same place despite significant changes in appearance and viewpoint. VPR is a key component of Spatial Artificial Intelligence, enabling robotic platforms and intelligent augmentation platforms such as augmented reality devices to perceive and understand the physical world. In this paper, we observe that there are three "drivers" that impose requirements on spatially intelligent agents and thus VPR systems: 1) the particular agent including its sensors and computational resources, 2) the operating environment of this agent, and 3) the specific task that the artificial agent carries out. In this paper, we characterize and survey key works in the VPR area considering those drivers, including their place representation and place matching choices. We also provide a new definition of VPR based on the visual overlap -- akin to spatial view cells in the brain -- that enables us to find similarities and differences to other research areas in the robotics and computer vision fields. We identify numerous open challenges and suggest areas that require more in-depth attention in future works.

arXiv commentAccepted to the International Joint Conference on Artificial Intelligence (IJCAI2021)

Cited by in corpus (20)

• The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection
• Visual Place Recognition: A Tutorial
• MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagery
• Spiking Neural Networks for Visual Place Recognition via Weighted Neuronal Assignments
• AirLoop: Lifelong Loop Closure Detection
• Applications of Spiking Neural Networks in Visual Place Recognition
• GraffMatch: Global Matching of 3D Lines and Planes for Wide Baseline LiDAR Registration
• EchoVPR: Echo State Networks for Visual Place Recognition
• U-BEV: Height-aware Bird's-Eye-View Segmentation and Neural Map-based Relocalization
• Self-Supervised Domain Calibration and Uncertainty Estimation for Place Recognition
• Unifying Local and Global Multimodal Features for Place Recognition in Aliased and Low-Texture Environments
• Boosting Performance of a Baseline Visual Place Recognition Technique by Predicting the Maximally Complementary Technique
• EDTformer: An Efficient Decoder Transformer for Visual Place Recognition
• CoPR: Towards Accurate Visual Localization With Continuous Place-descriptor Regression
• Ensemble-Based Event Camera Place Recognition Under Varying Illumination
• CurriculumLoc: Enhancing Cross-Domain Geolocalization through Multi-Stage Refinement
• Image-Based Relocalization and Alignment for Long-Term Monitoring of Dynamic Underwater Environments
• Addressing the challenges of loop detection in agricultural environments
• Long-Term Visual Localization in Dynamic Benthic Environments: A Dataset, Footprint-Based Ground Truth, and Visual Place Recognition Benchmark
• Improved Bag-of-Words Image Retrieval with Geometric Constraints for Ground Texture Localization