P2P-NET: Bidirectional Point Displacement Net for Shape Transform

Abstract

We introduce P2P-NET, a general-purpose deep neural network which learns geometric transformations between point-based shape representations from two domains, e.g., meso-skeletons and surfaces, partial and complete scans, etc. The architecture of the P2P-NET is that of a bi-directional point displacement network, which transforms a source point set to a target point set with the same cardinality, and vice versa, by applying point-wise displacement vectors learned from data. P2P-NET is trained on paired shapes from the source and target domains, but without relying on point-to-point correspondences between the source and target point sets. The training loss combines two uni-directional geometric losses, each enforcing a shape-wise similarity between the predicted and the target point sets, and a cross-regularization term to encourage consistency between displacement vectors going in opposite directions. We develop and present several different applications enabled by our general-purpose bidirectional P2P-NET to highlight the effectiveness, versatility, and potential of our network in solving a variety of point-based shape transformation problems.

siggraph revision is done. 13 pages

References in corpus (1)

• ComplementMe: Weakly-Supervised Component Suggestions for 3D Modeling

Cited by in corpus (11)

• RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloud
• LOGAN: Unpaired Shape Transform in Latent Overcomplete Space
• ME-PCN: Point Completion Conditioned on Mask Emptiness
• PointSCNet: Point Cloud Structure and Correlation Learning Based on Space Filling Curve-Guided Sampling
• Learning Mesh Representations via Binary Space Partitioning Tree Networks
• Deep Learning-based Facial Appearance Simulation Driven by Surgically Planned Craniomaxillofacial Bony Movement
• Task-Aware Sampling Layer for Point-Wise Analysis
• Shape Completion with Points in the Shadow
• TCFNet: Bidirectional face-bone transformation via a Transformer-based coarse-to-fine point movement network
• Learning Localization of Body and Finger Animation Skeleton Joints on Three-Dimensional Models of Human Bodies
• PDT: Point Distribution Transformation with Diffusion Models