Parametric Surface Constrained Upsampler Network for Point Cloud

Abstract

Designing a point cloud upsampler, which aims to generate a clean and dense point cloud given a sparse point representation, is a fundamental and challenging problem in computer vision. A line of attempts achieves this goal by establishing a point-to-point mapping function via deep neural networks. However, these approaches are prone to produce outlier points due to the lack of explicit surface-level constraints. To solve this problem, we introduce a novel surface regularizer into the upsampler network by forcing the neural network to learn the underlying parametric surface represented by bicubic functions and rotation functions, where the new generated points are then constrained on the underlying surface. These designs are integrated into two different networks for two tasks that take advantages of upsampling layers - point cloud upsampling and point cloud completion for evaluation. The state-of-the-art experimental results on both tasks demonstrate the effectiveness of the proposed method. The code is available at https://github.com/corecai163/PSCU.

arXiv commentUpdate Supplementary Files

References in corpus (19)

• PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
• ShapeNet: An Information-Rich 3D Model Repository
• PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
• PU-Net: Point Cloud Upsampling Network
• On the Continuity of Rotation Representations in Neural Networks
• PF-Net: Point Fractal Network for 3D Point Cloud Completion
• Patch-based Progressive 3D Point Set Upsampling
• GRNet: Gridding Residual Network for Dense Point Cloud Completion
• Morphing and Sampling Network for Dense Point Cloud Completion
• PU-GCN: Point Cloud Upsampling using Graph Convolutional Networks
• Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Review
• PointAugment: an Auto-Augmentation Framework for Point Cloud Classification
• PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Paths
• PU-Transformer: Point Cloud Upsampling Transformer
• Point Cloud Completion by Skip-attention Network with Hierarchical Folding
• PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling
• Meta-PU: An Arbitrary-Scale Upsampling Network for Point Cloud
• Detail Preserved Point Cloud Completion via Separated Feature Aggregation
• SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization