The general theory of permutation equivarant neural networks and higher order graph variational encoders
arXiv:2004.03990
Abstract
Previous work on symmetric group equivariant neural networks generally only considered the case where the group acts by permuting the elements of a single vector. In this paper we derive formulae for general permutation equivariant layers, including the case where the layer acts on matrices by permuting their rows and columns simultaneously. This case arises naturally in graph learning and relation learning applications. As a specific case of higher order permutation equivariant networks, we present a second order graph variational encoder, and show that the latent distribution of equivariant generative models must be exchangeable. We demonstrate the efficacy of this architecture on the tasks of link prediction in citation graphs and molecular graph generation.
References in corpus (10)
- Neural Message Passing for Quantum Chemistry
- Variational Graph Auto-Encoders
- On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups
- 3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data
- Rotation equivariant vector field networks
- Equivariance Through Parameter-Sharing
- Invariant and Equivariant Graph Networks
- Permutation-equivariant neural networks applied to dynamics prediction
- Universal approximations of permutation invariant/equivariant functions by deep neural networks
- Graph Star Net for Generalized Multi-Task Learning