An Improvement of Data Classification Using Random Multimodel Deep Learning (RMDL)

Abstract

The exponential growth in the number of complex datasets every year requires more enhancement in machine learning methods to provide robust and accurate data classification. Lately, deep learning approaches have achieved surpassing results in comparison to previous machine learning algorithms. However, finding the suitable structure for these models has been a challenge for researchers. This paper introduces Random Multimodel Deep Learning (RMDL): a new ensemble, deep learning approach for classification. RMDL solves the problem of finding the best deep learning structure and architecture while simultaneously improving robustness and accuracy through ensembles of deep learning architectures. In short, RMDL trains multiple randomly generated models of Deep Neural Network (DNN), Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) in parallel and combines their results to produce better result of any of those models individually. In this paper, we describe RMDL model and compare the results for image and text classification as well as face recognition. We used MNIST and CIFAR-10 datasets as ground truth datasets for image classification and WOS, Reuters, IMDB, and 20newsgroup datasets for text classification. Lastly, we used ORL dataset to compare the model performance on face recognition task.

arXiv commentpublished in International Journal of Machine Learning and Computing (IJMLC). arXiv admin note: substantial text overlap with arXiv:1805.01890

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• Scikit-learn: Machine Learning in Python
• Efficient Estimation of Word Representations in Vector Space
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Machine Learning in Automated Text Categorization
• ADADELTA: An Adaptive Learning Rate Method
• On the difficulty of training Recurrent Neural Networks
• BinaryConnect: Training Deep Neural Networks with binary weights during propagations
• PCANet: A Simple Deep Learning Baseline for Image Classification?
• Deep Learning using Linear Support Vector Machines
• HDLTex: Hierarchical Deep Learning for Text Classification
• Effective Use of Word Order for Text Categorization with Convolutional Neural Networks
• Deep EndoVO: A Recurrent Convolutional Neural Network (RCNN) based Visual Odometry Approach for Endoscopic Capsule Robots
• RMDL: Random Multimodel Deep Learning for Classification
• GaKCo: a Fast GApped k-mer string Kernel using COunting

Cited by in corpus (4)

• Analysis of Railway Accidents' Narratives Using Deep Learning
• Gender Detection on Social Networks using Ensemble Deep Learning
• Sparse Longitudinal Representations of Electronic Health Record Data for the Early Detection of Chronic Kidney Disease in Diabetic Patients
• Diagnosis and Analysis of Celiac Disease and Environmental Enteropathy on Biopsy Images using Deep Learning Approaches