The Surface Edge Explorer (SEE): A measurement-direct approach to next best view planning
arXiv:2207.13684 · doi:10.1177/02783649241230098
Abstract
High-quality observations of the real world are crucial for a variety of applications, including producing 3D printed replicas of small-scale scenes and conducting inspections of large-scale infrastructure. These 3D observations are commonly obtained by combining multiple sensor measurements from different views. Guiding the selection of suitable views is known as the NBV planning problem. Most NBV approaches reason about measurements using rigid data structures (e.g., surface meshes or voxel grids). This simplifies next best view selection but can be computationally expensive, reduces real-world fidelity, and couples the selection of a next best view with the final data processing. This paper presents the Surface Edge Explorer, a NBV approach that selects new observations directly from previous sensor measurements without requiring rigid data structures. SEE uses measurement density to propose next best views that increase coverage of insufficiently observed surfaces while avoiding potential occlusions. Statistical results from simulated experiments show that SEE can attain similar or better surface coverage with less observation time and travel distance than evaluated volumetric approaches on both small- and large-scale scenes. Real-world experiments demonstrate SEE autonomously observing a deer statue using a 3D sensor affixed to a robotic arm.
arXiv commentThe International Journal of Robotics Research (IJRR) 2024, Vol. 0(0) 1-27. 25 pages, 17 figures, 6 tables. Videos available at https://www.youtube.com/watch?v=dqppqRlaGEA and https://www.youtube.com/playlist?list=PLbaQBz4TuPcyNh4COoaCtC1ZGhpbEkFEo
References in corpus (11)
- An Efficient Sampling-based Method for Online Informative Path Planning in Unknown Environments
- Autonomous UAV Exploration of Dynamic Environments via Incremental Sampling and Probabilistic Roadmap
- Heterogeneous Ground and Air Platforms, Homogeneous Sensing: Team CSIRO Data61's Approach to the DARPA Subterranean Challenge
- A Multi-Resolution Frontier-Based Planner for Autonomous 3D Exploration
- Adaptively Informed Trees (AIT*): Fast Asymptotically Optimal Path Planning through Adaptive Heuristics
- Supervised Learning of the Next-Best-View for 3D Object Reconstruction
- NeurAR: Neural Uncertainty for Autonomous 3D Reconstruction with Implicit Neural Representations
- AIT* and EIT*: Asymmetric bidirectional sampling-based path planning
- Surface Edge Explorer (SEE): Planning Next Best Views Directly from 3D Observations
- Multi-Sensor Next-Best-View Planning as Matroid-Constrained Submodular Maximization
- Proactive Estimation of Occlusions and Scene Coverage for Planning Next Best Views in an Unstructured Representation