Three-Filters-to-Normal: An Accurate and Ultrafast Surface Normal Estimator
arXiv:2005.08165 · doi:10.1109/LRA.2021.3067308
Abstract
This paper proposes three-filters-to-normal (3F2N), an accurate and ultrafast surface normal estimator (SNE), which is designed for structured range sensor data, e.g., depth/disparity images. 3F2N SNE computes surface normals by simply performing three filtering operations (two image gradient filters in horizontal and vertical directions, respectively, and a mean/median filter) on an inverse depth image or a disparity image. Despite the simplicity of 3F2N SNE, no similar method already exists in the literature. To evaluate the performance of our proposed SNE, we created three large-scale synthetic datasets (easy, medium and hard) using 24 3D mesh models, each of which is used to generate 1800--2500 pairs of depth images (resolution: 480X640 pixels) and the corresponding ground-truth surface normal maps from different views. 3F2N SNE demonstrates the state-of-the-art performance, outperforming all other existing geometry-based SNEs, where the average angular errors with respect to the easy, medium and hard datasets are 1.66 degrees, 5.69 degrees and 15.31 degrees, respectively. Furthermore, our C++ and CUDA implementations achieve a processing speed of over 260 Hz and 21 kHz, respectively. Our datasets and source code are publicly available at sites.google.com/view/3f2n.
arXiv commentwebpage: sites.google.com/view/3f2n, accepted to IEEE RA-L and ICRA'21
References in corpus (7)
- ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
- Pothole Detection Based on Disparity Transformation and Road Surface Modeling
- SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detection
- Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithms
- PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing
- DIODE: A Dense Indoor and Outdoor DEpth Dataset
- Computer Stereo Vision for Autonomous Driving
Cited by in corpus (5)
- SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detection
- Computer Stereo Vision for Autonomous Driving
- LightDepth: Single-View Depth Self-Supervision from Illumination Decline
- Normal Transformer: Extracting Surface Geometry from LiDAR Points Enhanced by Visual Semantics
- S2P2: Self-Supervised Goal-Directed Path Planning Using RGB-D Data for Robotic Wheelchairs