Sparse Unsupervised Capsules Generalize Better

David Rawlinson, Abdelrahman Ahmed, Gideon Kowadlo

We show that unsupervised training of latent capsule layers using only the reconstruction loss, without masking to select the correct output class, causes a loss of equivariances a…