MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagery
arXiv:2202.09146 · doi:10.1109/LRA.2022.3147257
Abstract
Visual Place Recognition (VPR) is a crucial component of 6-DoF localization, visual SLAM and structure-from-motion pipelines, tasked to generate an initial list of place match hypotheses by matching global place descriptors. However, commonly-used CNN-based methods either process multiple image resolutions after training or use a single resolution and limit multi-scale feature extraction to the last convolutional layer during training. In this paper, we augment NetVLAD representation learning with low-resolution image pyramid encoding which leads to richer place representations. The resultant multi-resolution feature pyramid can be conveniently aggregated through VLAD into a single compact representation, avoiding the need for concatenation or summation of multiple patches in recent multi-scale approaches. Furthermore, we show that the underlying learnt feature tensor can be combined with existing multi-scale approaches to improve their baseline performance. Evaluation on 15 viewpoint-varying and viewpoint-consistent benchmarking datasets confirm that the proposed MultiRes-NetVLAD leads to state-of-the-art Recall@N performance for global descriptor based retrieval, compared against 11 existing techniques. Source code is publicly available at https://github.com/Ahmedest61/MultiRes-NetVLAD.
arXiv comment12 pages, 6 Figures, Accepted for publication in IEEE RA-L 2022 and ICRA 2022, includes supplementary material
References in corpus (8)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- Particular object retrieval with integral max-pooling of CNN activations
- SegMatch: Segment based loop-closure for 3D point clouds
- Semantics for Robotic Mapping, Perception and Interaction: A Survey
- Where is your place, Visual Place Recognition?
- Attention-based Pyramid Aggregation Network for Visual Place Recognition
- Levelling the Playing Field: A Comprehensive Comparison of Visual Place Recognition Approaches under Changing Conditions