Cross-calibration of Time-of-flight and Colour Cameras

Abstract

Time-of-flight cameras provide depth information, which is complementary to the photometric appearance of the scene in ordinary images. It is desirable to merge the depth and colour information, in order to obtain a coherent scene representation. However, the individual cameras will have different viewpoints, resolutions and fields of view, which means that they must be mutually calibrated. This paper presents a geometric framework for this multi-view and multi-modal calibration problem. It is shown that three-dimensional projective transformations can be used to align depth and parallax-based representations of the scene, with or without Euclidean reconstruction. A new evaluation procedure is also developed; this allows the reprojection error to be decomposed into calibration and sensor-dependent components. The complete approach is demonstrated on a network of three time-of-flight and six colour cameras. The applications of such a system, to a range of automatic scene-interpretation problems, are discussed.

18 pages, 12 figures, 3 tables

References in corpus (5)

• Statistical Methods for Estimating Complexity from Competition Experiments between Two Populations
• How to model marine reserves ?
• Efficient Solution to the 3D Problem of Automatic Wall Paintings Reassembly
• High-Resolution Depth Maps Based on TOF-Stereo Fusion
• Automatic Detection of Calibration Grids in Time-of-Flight Images

Cited by in corpus (4)

• An Overview of Depth Cameras and Range Scanners Based on Time-of-Flight Technologies
• Blind MultiChannel Identification and Equalization for Dereverberation and Noise Reduction based on Convolutive Transfer Function
• Joint Alignment of Multiple Point Sets with Batch and Incremental Expectation-Maximization
• Fusion of Range and Stereo Data for High-Resolution Scene-Modeling