Unsupervised Geometric Disentanglement for Surfaces via CFAN-VAE
arXiv:2005.11622
Abstract
Geometric disentanglement, the separation of latent codes for intrinsic (i.e. identity) and extrinsic(i.e. pose) geometry, is a prominent task for generative models of non-Euclidean data such as 3D deformable models. It provides greater interpretability of the latent space, and leads to more control in generation. This work introduces a mesh feature, the conformal factor and normal feature (CFAN),for use in mesh convolutional autoencoders. We further propose CFAN-VAE, a novel architecture that disentangles identity and pose using the CFAN feature. Requiring no label information on the identity or pose during training, CFAN-VAE achieves geometric disentanglement in an unsupervisedway. Our comprehensive experiments, including reconstruction, interpolation, generation, and identity/pose transfer, demonstrate CFAN-VAE achieves state-of-the-art performance on unsupervised geometric disentanglement. We also successfully detect a level of geometric disentanglement in mesh convolutional autoencoders that encode xyz-coordinates directly by registering its latent space to that of CFAN-VAE.
arXiv comment17 pages, 8 figures
References in corpus (12)
- Decoupled Weight Decay Regularization
- Semi-Supervised Classification with Graph Convolutional Networks
- Deep Learning with Differential Privacy
- Geometric deep learning: going beyond Euclidean data
- Spectral Networks and Locally Connected Networks on Graphs
- Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
- Learning from Synthetic Humans
- MeshGAN: Non-linear 3D Morphable Models of Faces
- Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generation
- Parallel Transport Convolution: A New Tool for Convolutional Neural Networks on Manifolds
- Latent feature disentanglement for 3D meshes
- NPTC-net: Narrow-Band Parallel Transport Convolutional Neural Network on Point Clouds