Non-Parametric Transformation Networks
arXiv:1801.04520
Abstract
ConvNets, through their architecture, only enforce invariance to translation. In this paper, we introduce a new class of deep convolutional architectures called Non-Parametric Transformation Networks (NPTNs) which can learn \textit{general} invariances and symmetries directly from data. NPTNs are a natural generalization of ConvNets and can be optimized directly using gradient descent. Unlike almost all previous works in deep architectures, they make no assumption regarding the structure of the invariances present in the data and in that aspect are flexible and powerful. We also model ConvNets and NPTNs under a unified framework called Transformation Networks (TN), which yields a better understanding of the connection between the two. We demonstrate the efficacy of NPTNs on data such as MNIST with extreme transformations and CIFAR10 where they outperform baselines, and further outperform several recent algorithms on ETH-80. They do so while having the same number of parameters. We also show that they are more effective than ConvNets in modelling symmetries and invariances from data, without the explicit knowledge of the added arbitrary nuisance transformations. Finally, we replace ConvNets with NPTNs within Capsule Networks and show that this enables Capsule Nets to perform even better.
arXiv commentPreprint only
References in corpus (10)
- Densely Connected Convolutional Networks
- Wide Residual Networks
- Scale-Invariant Convolutional Neural Networks
- Unsupervised Learning of Invariant Representations in Hierarchical Architectures
- Graph-based Isometry Invariant Representation Learning
- Dual Path Networks
- Learning to Extract Motion from Videos in Convolutional Neural Networks
- Flip-Rotate-Pooling Convolution and Split Dropout on Convolution Neural Networks for Image Classification
- Deep Rotation Equivariant Network
- Max-Margin Invariant Features from Transformed Unlabeled Data