Mapping in a cycle: Sinkhorn regularized unsupervised learning for point cloud shapes
arXiv:2007.09594
Abstract
We propose an unsupervised learning framework with the pretext task of finding dense correspondences between point cloud shapes from the same category based on the cycle-consistency formulation. In order to learn discriminative pointwise features from point cloud data, we incorporate in the formulation a regularization term based on Sinkhorn normalization to enhance the learned pointwise mappings to be as bijective as possible. Besides, a random rigid transform of the source shape is introduced to form a triplet cycle to improve the model's robustness against perturbations. Comprehensive experiments demonstrate that the learned pointwise features through our framework benefits various point cloud analysis tasks, e.g. partial shape registration and keypoint transfer. We also show that the learned pointwise features can be leveraged by supervised methods to improve the part segmentation performance with either the full training dataset or just a small portion of it.
Accepted to ECCV2020
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- A Simple Framework for Contrastive Learning of Visual Representations
- On the Convergence of Adam and Beyond
- Momentum Contrast for Unsupervised Visual Representation Learning
- On Mutual Information Maximization for Representation Learning
- Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks
- PRNet: Self-Supervised Learning for Partial-to-Partial Registration
- Ranking via Sinkhorn Propagation