Multiway Non-rigid Point Cloud Registration via Learned Functional Map Synchronization

Abstract

We present SyNoRiM, a novel way to jointly register multiple non-rigid shapes by synchronizing the maps relating learned functions defined on the point clouds. Even though the ability to process non-rigid shapes is critical in various applications ranging from computer animation to 3D digitization, the literature still lacks a robust and flexible framework to match and align a collection of real, noisy scans observed under occlusions. Given a set of such point clouds, our method first computes the pairwise correspondences parameterized via functional maps. We simultaneously learn potentially non-orthogonal basis functions to effectively regularize the deformations, while handling the occlusions in an elegant way. To maximally benefit from the multi-way information provided by the inferred pairwise deformation fields, we synchronize the pairwise functional maps into a cycle-consistent whole thanks to our novel and principled optimization formulation. We demonstrate via extensive experiments that our method achieves a state-of-the-art performance in registration accuracy, while being flexible and efficient as we handle both non-rigid and multi-body cases in a unified framework and avoid the costly optimization over point-wise permutations by the use of basis function maps.

References in corpus (12)

• Decoupled Weight Decay Regularization
• Instance Normalization: The Missing Ingredient for Fast Stylization
• Point-Set Registration: Coherent Point Drift
• A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation
• Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
• Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiation
• Disentangled Human Body Embedding Based on Deep Hierarchical Neural Network
• Deep Shells: Unsupervised Shape Correspondence with Optimal Transport
• Probabilistic Permutation Synchronization using the Riemannian Structure of the Birkhoff Polytope
• Bayesian Pose Graph Optimization via Bingham Distributions and Tempered Geodesic MCMC
• Occlusion Guided Self-supervised Scene Flow Estimation on 3D Point Clouds
• 4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface

Cited by in corpus (2)

• SynBench: A Synthetic Benchmark for Non-rigid 3D Point Cloud Registration
• Robust-DefReg: A Robust Deformable Point Cloud Registration Method based on Graph Convolutional Neural Networks