Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers
arXiv:1905.06700 · doi:10.1038/s41467-019-12943-7
Abstract
Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20 ms, where the lidar data was acquired in broad daylight from distances up to 320 metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.
References in corpus (8)
- Single-pixel 3D imaging with time-based depth resolution
- An Overview of Depth Cameras and Range Scanners Based on Time-of-Flight Technologies
- Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
- A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging
- Photon-Efficient Computational 3D and Reflectivity Imaging with Single-Photon Detectors
- Lidar waveform based analysis of depth images constructed using sparse single-photon data
- Bayesian 3D Reconstruction of Complex Scenes from Single-Photon Lidar Data
- Algorithm-Induced Prior for Image Restoration
Cited by in corpus (20)
- Single-photon imaging over 200 km
- Super-resolution single-photon imaging at 8.2 kilometers
- Seeing Around Corners with Edge-Resolved Transient Imaging
- Metasurface-dressed two-dimensional on-chip waveguide for free-space light field manipulation
- Spatial images from temporal data
- Fast online 3D reconstruction of dynamic scenes from individual single-photon detection events
- TreeSketchNet: From Sketch To 3D Tree Parameters Generation
- A Bayesian Based Deep Unrolling Algorithm for Single-Photon Lidar Systems
- Robust 3D reconstruction of dynamic scenes from single-photon lidar using Beta-divergences
- Dynamic-quenching of a single-photon avalanche photodetector using an adaptive resistive switch
- Satellite-Based Quantum Key Distribution in the Presence of Bypass Channels
- Demonstration of quantum-enhanced rangefinding robust against classical jamming
- 3D Target Detection and Spectral Classification for Single-photon LiDAR Data
- Quantum Target Ranging for LiDAR
- A Sketching Framework for Reduced Data Transfer in Photon Counting Lidar
- Low-complexity Point Cloud Filtering for LiDAR by PCA-based Dimension Reduction
- Active 3D Shape Reconstruction from Vision and Touch
- EM-based approach to 3D reconstruction from single-waveform multispectral Lidar data
- Zero-Truncated Poisson Regression for Sparse Multiway Count Data Corrupted by False Zeros
- Chernoff Information Bottleneck for Covert Quantum Target Sensing