MeshWalker: Deep Mesh Understanding by Random Walks
arXiv:2006.05353
Abstract
Most attempts to represent 3D shapes for deep learning have focused on volumetric grids, multi-view images and point clouds. In this paper we look at the most popular representation of 3D shapes in computer graphics - a triangular mesh - and ask how it can be utilized within deep learning. The few attempts to answer this question propose to adapt convolutions & pooling to suit Convolutional Neural Networks (CNNs). This paper proposes a very different approach, termed MeshWalker, to learn the shape directly from a given mesh. The key idea is to represent the mesh by random walks along the surface, which "explore" the mesh's geometry and topology. Each walk is organized as a list of vertices, which in some manner imposes regularity on the mesh. The walk is fed into a Recurrent Neural Network (RNN) that "remembers" the history of the walk. We show that our approach achieves state-of-the-art results for two fundamental shape analysis tasks: shape classification and semantic segmentation. Furthermore, even a very small number of examples suffices for learning. This is highly important, since large datasets of meshes are difficult to acquire.
References in corpus (13)
- Adam: A Method for Stochastic Optimization
- Semi-Supervised Classification with Graph Convolutional Networks
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Deep Convolutional Networks on Graph-Structured Data
- MeshCNN: A Network with an Edge
- Generative and Discriminative Voxel Modeling with Convolutional Neural Networks
- PCPNET: Learning Local Shape Properties from Raw Point Clouds
- Classification of Point Cloud Scenes with Multiscale Voxel Deep Network
- Dominant Set Clustering and Pooling for Multi-View 3D Object Recognition
- Geometry Sharing Network for 3D Point Cloud Classification and Segmentation
- Continuous Geodesic Convolutions for Learning on 3D Shapes
- Random Walks on Complex Networks