Proximity Forest: An effective and scalable distance-based classifier for time series

Abstract

Research into the classification of time series has made enormous progress in the last decade. The UCR time series archive has played a significant role in challenging and guiding the development of new learners for time series classification. The largest dataset in the UCR archive holds 10 thousand time series only; which may explain why the primary research focus has been in creating algorithms that have high accuracy on relatively small datasets. This paper introduces Proximity Forest, an algorithm that learns accurate models from datasets with millions of time series, and classifies a time series in milliseconds. The models are ensembles of highly randomized Proximity Trees. Whereas conventional decision trees branch on attribute values (and usually perform poorly on time series), Proximity Trees branch on the proximity of time series to one exemplar time series or another; allowing us to leverage the decades of work into developing relevant measures for time series. Proximity Forest gains both efficiency and accuracy by stochastic selection of both exemplars and similarity measures. Our work is motivated by recent time series applications that provide orders of magnitude more time series than the UCR benchmarks. Our experiments demonstrate that Proximity Forest is highly competitive on the UCR archive: it ranks among the most accurate classifiers while being significantly faster. We demonstrate on a 1M time series Earth observation dataset that Proximity Forest retains this accuracy on datasets that are many orders of magnitude greater than those in the UCR repository, while learning its models at least 100,000 times faster than current state of the art models Elastic Ensemble and COTE.

30 pages, 12 figures

References in corpus (3)

• Time Warp Edit Distance with Stiffness Adjustment for Time Series Matching
• Fast and Accurate Time Series Classification with WEASEL
• Faster Retrieval with a Two-Pass Dynamic-Time-Warping Lower Bound

Cited by in corpus (14)

• InceptionTime: Finding AlexNet for Time Series Classification
• ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernels
• MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification
• HIVE-COTE 2.0: a new meta ensemble for time series classification
• TS-CHIEF: A Scalable and Accurate Forest Algorithm for Time Series Classification
• Bake off redux: a review and experimental evaluation of recent time series classification algorithms
• The Canonical Interval Forest (CIF) Classifier for Time Series Classification
• Deep Neural Network Ensembles for Time Series Classification
• Scalable Dictionary Classifiers for Time Series Classification
• Time-Series Classification in Smart Manufacturing Systems: An Experimental Evaluation of State-of-the-Art Machine Learning Algorithms
• The Channel as a Traffic Sensor: Vehicle Detection and Classification based on Radio Fingerprinting
• Automatic classification of plasma regions in near-Earth space with supervised machine learning: application to Magnetospheric Multi Scale 2016-2019 observations
• dCAM: Dimension-wise Class Activation Map for Explaining Multivariate Data Series Classification
• Enhancing Time Series Classification with Diversity-Driven Neural Network Ensembles