The Temporal Dictionary Ensemble (TDE) Classifier for Time Series Classification

Abstract

Using bag of words representations of time series is a popular approach to time series classification. These algorithms involve approximating and discretising windows over a series to form words, then forming a count of words over a given dictionary. Classifiers are constructed on the resulting histograms of word counts. A 2017 evaluation of a range of time series classifiers found the bag of symbolic-fourier approximation symbols (BOSS) ensemble the best of the dictionary based classifiers. It forms one of the components of hierarchical vote collective of transformation-based ensembles (HIVE-COTE), which represents the current state of the art. Since then, several new dictionary based algorithms have been proposed that are more accurate or more scalable (or both) than BOSS. We propose a further extension of these dictionary based classifiers that combines the best elements of the others combined with a novel approach to constructing ensemble members based on an adaptive Gaussian process model of the parameter space. We demonstrate that the temporal dictionary ensemble (TDE) is more accurate than other dictionary based approaches. Furthermore, unlike the other classifiers, if we replace BOSS in HIVE-COTE with TDE, HIVE-COTE is significantly more accurate. We also show this new version of HIVE-COTE is significantly more accurate than the current best deep learning approach, a recently proposed hybrid tree ensemble and a recently introduced competitive classifier making use of highly randomised convolutional kernels. This advance represents a new state of the art for time series classification.

arXiv admin note: text overlap with arXiv:1911.12008

References in corpus (6)

• ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernels
• Fast and Accurate Time Series Classification with WEASEL
• TS-CHIEF: A Scalable and Accurate Forest Algorithm for Time Series Classification
• Scalable Dictionary Classifiers for Time Series Classification
• From BOP to BOSS and Beyond: Time Series Classification with Dictionary Based Classifiers
• A tale of two toolkits, report the third: on the usage and performance of HIVE-COTE v1.0

Cited by in corpus (8)

• HIVE-COTE 2.0: a new meta ensemble for time series classification
• Bake off redux: a review and experimental evaluation of recent time series classification algorithms
• The FreshPRINCE: A Simple Transformation Based Pipeline Time Series Classifier
• Random Dilated Shapelet Transform: A New Approach for Time Series Shapelets
• Unsupervised Feature Based Algorithms for Time Series Extrinsic Regression
• Automatic Feature Engineering for Time Series Classification: Evaluation and Discussion
• FedST: Secure Federated Shapelet Transformation for Time Series Classification
• A Dictionary-based approach to Time Series Ordinal Classification