Point Discriminative Learning for Data-efficient 3D Point Cloud Analysis

Abstract

3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficient learning methods. In this work we propose PointDisc, a point discriminative learning method to leverage self-supervisions for data-efficient 3D point cloud classification and segmentation. PointDisc imposes a novel point discrimination loss on the middle and global level features produced by the backbone network. This point discrimination loss enforces learned features to be consistent with points belonging to the corresponding local shape region and inconsistent with randomly sampled noisy points. We conduct extensive experiments on 3D object classification, 3D semantic and part segmentation, showing the benefits of PointDisc for data-efficient learning. Detailed analysis demonstrate that PointDisc learns unsupervised features that well capture local and global geometry.

This work is published in 3DV 2022

References in corpus (8)

• A Simple Framework for Contrastive Learning of Visual Representations
• Learning deep representations by mutual information estimation and maximization
• Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
• Learning Representations and Generative Models for 3D Point Clouds
• Modulating early visual processing by language
• PointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding
• PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representation
• Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-based Sequence to Sequence Network