A Region-based Gauss-Newton Approach to Real-Time Monocular Multiple Object Tracking

Abstract

We propose an algorithm for real-time 6DOF pose tracking of rigid 3D objects using a monocular RGB camera. The key idea is to derive a region-based cost function using temporally consistent local color histograms. While such region-based cost functions are commonly optimized using first-order gradient descent techniques, we systematically derive a Gauss-Newton optimization scheme which gives rise to drastically faster convergence and highly accurate and robust tracking performance. We furthermore propose a novel complex dataset dedicated for the task of monocular object pose tracking and make it publicly available to the community. To our knowledge, it is the first to address the common and important scenario in which both the camera as well as the objects are moving simultaneously in cluttered scenes. In numerous experiments - including our own proposed dataset - we demonstrate that the proposed Gauss-Newton approach outperforms existing approaches, in particular in the presence of cluttered backgrounds, heterogeneous objects and partial occlusions.

References in corpus (1)

• ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras

Cited by in corpus (8)

• SRT3D: A Sparse Region-Based 3D Object Tracking Approach for the Real World
• Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks
• Combining Local and Global Pose Estimation for Precise Tracking of Similar Objects
• A Novel Wide-Area Multiobject Detection System with High-Probability Region Searching
• Optical Flow-Guided 6DoF Object Pose Tracking with an Event Camera
• Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domains
• Robust 6DoF Pose Tracking Considering Contour and Interior Correspondence Uncertainty for AR Assembly Guidance
• Robust Visual Localization in Compute-Constrained Environments by Salient Edge Rendering and Weighted Hamming Similarity