Rendering the Directional TSDF for Tracking and Multi-Sensor Registration with Point-To-Plane Scale ICP

Abstract

Dense real-time tracking and mapping from RGB-D images is an important tool for many robotic applications, such as navigation and manipulation. The recently presented Directional Truncated Signed Distance Function (DTSDF) is an augmentation of the regular TSDF that shows potential for more coherent maps and improved tracking performance. In this work, we present methods for rendering depth- and color images from the DTSDF, making it a true drop-in replacement for the regular TSDF in established trackers. We evaluate the algorithm on well-established datasets and observe that our method improves tracking performance and increases re-usability of mapped scenes. Furthermore, we add color integration which notably improves color-correctness at adjacent surfaces. Our novel formulation of combined ICP with frame-to-keyframe photometric error minimization further improves tracking results. Lastly, we introduce Sim3 point-to-plane ICP for refining pose priors in a multi-sensor scenario with different scale factors.

arXiv commentPublished in Robotics and Autonomous Systems, 2023. arXiv admin note: substantial text overlap with arXiv:2108.08115

References in corpus (6)

• ORB-SLAM: a Versatile and Accurate Monocular SLAM System
• Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning
• BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration
• InfiniTAM v3: A Framework for Large-Scale 3D Reconstruction with Loop Closure
• Redesigning SLAM for Arbitrary Multi-Camera Systems
• stdgpu: Efficient STL-like Data Structures on the GPU