A Classification Supervised Auto-Encoder Based on Predefined Evenly-Distributed Class Centroids

Abstract

Classic variational autoencoders are used to learn complex data distributions, that are built on standard function approximators. Especially, VAE has shown promise on a lot of complex task. In this paper, a new autoencoder model - classification supervised autoencoder (CSAE) based on predefined evenly-distributed class centroids (PEDCC) is proposed. Our method uses PEDCC of latent variables to train the network to ensure the maximization of inter-class distance and the minimization of inner-class distance. Instead of learning mean/variance of latent variables distribution and taking reparameterization of VAE, latent variables of CSAE are directly used to classify and as input of decoder. In addition, a new loss function is proposed to combine the loss function of classification. Based on the basic structure of the universal autoencoder, we realized the comprehensive optimal results of encoding, decoding, classification, and good model generalization performance at the same time. Theoretical advantages are reflected in experimental results.

arXiv comment16 pages,12 figures, 4 tables

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Auto-Encoding Variational Bayes
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Tutorial on Variational Autoencoders
• EMNIST: an extension of MNIST to handwritten letters
• Optimizing the Latent Space of Generative Networks
• Continual Classification Learning Using Generative Models

Cited by in corpus (4)

• Elephant Flows Detection Using Deep Neural Network, Convolutional Neural Network, Long Short Term Memory and Autoencoder
• A New Loss Function for CNN Classifier Based on Pre-defined Evenly-Distributed Class Centroids
• A Softmax-free Loss Function Based on Predefined Optimal-distribution of Latent Features for Deep Learning Classifier
• Semi-supervised learning method based on predefined evenly-distributed class centroids