Solving the Robot-World Hand-Eye(s) Calibration Problem with Iterative Methods

Abstract

Robot-world, hand-eye calibration is the problem of determining the transformation between the robot end-effector and a camera, as well as the transformation between the robot base and the world coordinate system. This relationship has been modeled as $\mathbf{AX}=\mathbf{ZB}$, where $\mathbf{X}$ and $\mathbf{Z}$ are unknown homogeneous transformation matrices. The successful execution of many robot manipulation tasks depends on determining these matrices accurately, and we are particularly interested in the use of calibration for use in vision tasks. In this work, we describe a collection of methods consisting of two cost function classes, three different parameterizations of rotation components, and separable versus simultaneous formulations. We explore the behavior of this collection of methods on real datasets and simulated datasets, and compare to seven other state-of-the-art methods. Our collection of methods return greater accuracy on many metrics as compared to the state-of-the-art. The collection of methods is extended to the problem of robot-world hand-multiple-eye calibration, and results are shown with two and three cameras mounted on the same robot.

25 pages, including Erratum

References in corpus (2)

• Hand-Eye Calibration
• Simultaneous Robot-World and Hand-Eye Calibration

Cited by in corpus (7)

• A robotic vision system to measure tree traits
• Unified Attitude Determination Problem from Vector Observations and Hand-eye Measurements
• Extrinsic Infrastructure Calibration Using the Hand-Eye Robot-World Formulation
• GBEC: Geometry-Based Hand-Eye Calibration
• Motion-based extrinsic sensor-to-sensor calibration: Effect of reference frame selection for new and existing methods
• Robotic Testbed for Rendezvous and Optical Navigation: Multi-Source Calibration and Machine Learning Use Cases
• A Certifably Correct Algorithm for Generalized Robot-World and Hand-Eye Calibration