Deep Neural Network Ensembles for Time Series Classification

Abstract

Deep neural networks have revolutionized many fields such as computer vision and natural language processing. Inspired by this recent success, deep learning started to show promising results for Time Series Classification (TSC). However, neural networks are still behind the state-of-the-art TSC algorithms, that are currently composed of ensembles of 37 non deep learning based classifiers. We attribute this gap in performance due to the lack of neural network ensembles for TSC. Therefore in this paper, we show how an ensemble of 60 deep learning models can significantly improve upon the current state-of-the-art performance of neural networks for TSC, when evaluated over the UCR/UEA archive: the largest publicly available benchmark for time series analysis. Finally, we show how our proposed Neural Network Ensemble (NNE) is the first time series classifier to outperform COTE while reaching similar performance to the current state-of-the-art ensemble HIVE-COTE.

arXiv commentAccepted at IJCNN 2019

References in corpus (11)

• Deep learning for time series classification: a review
• The Loss Surfaces of Multilayer Networks
• Multi-Scale Convolutional Neural Networks for Time Series Classification
• Transfer learning for time series classification
• Proximity Forest: An effective and scalable distance-based classifier for time series
• Should we really use post-hoc tests based on mean-ranks?
• Adversarial Attacks on Deep Neural Networks for Time Series Classification
• Evaluating surgical skills from kinematic data using convolutional neural networks
• Towards a universal neural network encoder for time series
• Data augmentation using synthetic data for time series classification with deep residual networks
• Deep neural network ensemble by data augmentation and bagging for skin lesion classification

Cited by in corpus (9)

• InceptionTime: Finding AlexNet for Time Series Classification
• ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernels
• Adversarial Attacks on Deep Neural Networks for Time Series Classification
• Deep Learning for Satellite Image Time Series Analysis: A Review
• Adversarial Attacks and Defenses in Physiological Computing: A Systematic Review
• Convolutional and Deep Learning based techniques for Time Series Ordinal Classification
• Residual Attention Net for Superior Cross-Domain Time Sequence Modeling
• Deep Network Ensemble Learning applied to Image Classification using CNN Trees
• Consumer Behaviour in Retail: Next Logical Purchase using Deep Neural Network