CageNet: A Meta-Framework for Learning on Wild Meshes

Abstract

Learning on triangle meshes has recently proven to be instrumental to a myriad of tasks, from shape classification, to segmentation, to deformation and animation, to mention just a few. While some of these applications are tackled through neural network architectures which are tailored to the application at hand, many others use generic frameworks for triangle meshes where the only customization required is the modification of the input features and the loss function. Our goal in this paper is to broaden the applicability of these generic frameworks to "wild", i.e. meshes in-the-wild which often have multiple components, non-manifold elements, disrupted connectivity, or a combination of these. We propose a configurable meta-framework based on the concept of caged geometry: Given a mesh, a cage is a single component manifold triangle mesh that envelopes it closely. Generalized barycentric coordinates map between functions on the cage, and functions on the mesh, allowing us to learn and test on a variety of data, in different applications. We demonstrate this concept by learning segmentation and skinning weights on difficult data, achieving better performance to state of the art techniques on wild meshes.

11 pages, 13 figures (excluding supplementary material)

References in corpus (8)

• Geometric deep learning: going beyond Euclidean data
• ShapeNet: An Information-Rich 3D Model Repository
• MeshCNN: A Network with an Edge
• Subdivision-Based Mesh Convolution Networks
• Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representations
• CNNs on Surfaces using Rotation-Equivariant Features
• Deep Geometric Texture Synthesis
• HeterSkinNet: A Heterogeneous Network for Skin Weights Prediction