Optically lightweight tracking of objects around a corner
arXiv:1606.01873 · doi:10.1038/srep32491
Abstract
The observation of objects located in inaccessible regions is a recurring challenge in a wide variety of important applications. Recent work has shown that indirect diffuse light reflections can be used to reconstruct objects and two-dimensional (2D) patterns around a corner. However, these prior methods always require some specialized setup involving either ultrafast detectors or narrowband light sources. Here we show that occluded objects can be tracked in real time using a standard 2D camera and a laser pointer. Unlike previous methods based on the backprojection approach, we formulate the problem in an analysis-by-synthesis sense. By repeatedly simulating light transport through the scene, we determine the set of object parameters that most closely fits the measured intensity distribution. We experimentally demonstrate that this approach is capable of following the translation of unknown objects, and translation and orientation of a known object, in real time.
15 pages, 6 figures
References in corpus (1)
Cited by in corpus (24)
- Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar
- Fast Back-Projection for Non-Line of Sight Reconstruction
- Non-line-of-sight imaging with picosecond temporal resolution
- Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging
- Non-line-of-sight 3D imaging with a single-pixel camera
- Passive optical time-of-flight for Non line-of-sight localization
- Multi-scale Convolutional Neural Networks for Inverse Problems
- Recent Advances in Imaging Around Corners
- A trillion frames per second: the techniques and applications of light-in-flight photography
- Multi-modal Non-line-of-sight Passive Imaging
- Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition
- Flash Photography for Data-Driven Hidden Scene Recovery
- Single photon imaging and sensing of obscured objects around the corner
- Adaptive Lighting for Data-Driven Non-Line-of-Sight 3D Localization and Object Identification
- Steady-state Non-Line-of-Sight Imaging
- A Calibration Scheme for Non-Line-of-Sight Imaging Setups
- Two-Dimensional Non-Line-of-Sight Scene Estimation from a Single Edge Occluder
- Efficient Non-Line-of-Sight Imaging from Transient Sinograms
- Miniaturized time-correlated single-photon counting module for time-of-flight non-line-of-sight imaging applications
- Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation
- Towards Non-Line-of-Sight Photography
- Enhancing Passive Non-Line-of-Sight Imaging Using Polarization Cues
- Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Path
- Recent Advances in Transient Imaging: A Computer Graphics and Vision Perspective