A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification

Abstract

Convolutional auto-encoders have shown their remarkable performance in stacking to deep convolutional neural networks for classifying image data during past several years. However, they are unable to construct the state-of-the-art convolutional neural networks due to their intrinsic architectures. In this regard, we propose a flexible convolutional auto-encoder by eliminating the constraints on the numbers of convolutional layers and pooling layers from the traditional convolutional auto-encoder. We also design an architecture discovery method by using particle swarm optimization, which is capable of automatically searching for the optimal architectures of the proposed flexible convolutional auto-encoder with much less computational resource and without any manual intervention. We use the designed architecture optimization algorithm to test the proposed flexible convolutional auto-encoder through utilizing one graphic processing unit card on four extensively used image classification datasets. Experimental results show that our work in this paper significantly outperform the peer competitors including the state-of-the-art algorithm.

Accepted by IEEE Transactions on Neural Networks and Learning Systems, 2018

References in corpus (4)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Designing Neural Network Architectures using Reinforcement Learning
• Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations

Cited by in corpus (12)

• A Survey on Evolutionary Neural Architecture Search
• Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap
• Autoencoding with a Classifier System
• Can Genetic Programming Do Manifold Learning Too?
• Quantum autoencoders for image classification
• Evolving Character-level Convolutional Neural Networks for Text Classification
• CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network
• Early Diagnosis of Retinal Blood Vessel Damage via Deep Learning-Powered Collective Intelligence Models
• An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters
• Multi-objective Search of Robust Neural Architectures against Multiple Types of Adversarial Attacks
• Neural Architecture Search based on Cartesian Genetic Programming Coding Method
• PSO-PS: Parameter Synchronization with Particle Swarm Optimization for Distributed Training of Deep Neural Networks