Learning Discriminative Features using Encoder-Decoder type Deep Neural Nets

Abstract

As machine learning is applied to an increasing variety of complex problems, which are defined by high dimensional and complex data sets, the necessity for task oriented feature learning grows in importance. With the advancement of Deep Learning algorithms, various successful feature learning techniques have evolved. In this paper, we present a novel way of learning discriminative features by training Deep Neural Nets which have Encoder or Decoder type architecture similar to an Autoencoder. We demonstrate that our approach can learn discriminative features which can perform better at pattern classification tasks when the number of training samples is relatively small in size.

12 pages, 8 figures and 8 tables

References in corpus (4)

• Deep Big Simple Neural Nets Excel on Handwritten Digit Recognition
• Kernel Principal Component Analysis and its Applications in Face Recognition and Active Shape Models
• Pattern Recognition and Memory Mapping using Mirroring Neural Networks
• A Mirroring Theorem and its Application to a New Method of Unsupervised Hierarchical Pattern Classification