PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features
arXiv:2102.12093
Abstract
Point cloud analysis without pose priors is very challenging in real applications, as the orientations of point clouds are often unknown. In this paper, we propose a brand new point-set learning framework PRIN, namely, Point-wise Rotation Invariant Network, focusing on rotation invariant feature extraction in point clouds analysis. We construct spherical signals by Density Aware Adaptive Sampling to deal with distorted point distributions in spherical space. Spherical Voxel Convolution and Point Re-sampling are proposed to extract rotation invariant features for each point. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Both PRIN and SPRIN can be applied to tasks ranging from object classification, part segmentation, to 3D feature matching and label alignment. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation. We also provide thorough theoretical proof and analysis for point-wise rotation invariance achieved by our methods. Our code is available on https://github.com/qq456cvb/SPRIN.
arXiv commentAccepted to IEEE Transactions on Pattern Analysis and Machine Intelligence
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
- Submanifold Sparse Convolutional Networks
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks
- Linked Dynamic Graph CNN: Learning on Point Cloud via Linking Hierarchical Features
- A Rotation-Invariant Framework for Deep Point Cloud Analysis
- Rotation-Invariant Local-to-Global Representation Learning for 3D Point Cloud