Towards a Near Universal Time Series Data Mining Tool: Introducing the Matrix Profile
arXiv:1811.03064
Abstract
The last decade has seen a flurry of research on all-pairs-similarity-search (or, self-join) for text, DNA, and a handful of other datatypes, and these systems have been applied to many diverse data mining problems. Surprisingly, however, little progress has been made on addressing this problem for time series subsequences. In this thesis, we have introduced a near universal time series data mining tool called matrix profile which solves the all-pairs-similarity-search problem and caches the output in an easy-to-access fashion. The proposed algorithm is not only parameter-free, exact and scalable, but also applicable for both single and multidimensional time series. By building time series data mining methods on top of matrix profile, many time series data mining tasks (e.g., motif discovery, discord discovery, shapelet discovery, semantic segmentation, and clustering) can be efficiently solved. Because the same matrix profile can be shared by a diverse set of time series data mining methods, matrix profile is versatile and computed-once-use-many-times data structure. We demonstrate the utility of matrix profile for many time series data mining problems, including motif discovery, discord discovery, weakly labeled time series classification, and representation learning on domains as diverse as seismology, entomology, music processing, bioinformatics, human activity monitoring, electrical power-demand monitoring, and medicine. We hope the matrix profile is not the end but the beginning of many more time series data mining projects.
arXiv commentPhD dissertation (2018)
References in corpus (19)
- Efficient Estimation of Word Representations in Vector Space
- Distributed Representations of Words and Phrases and their Compositionality
- Auto-Encoding Variational Bayes
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Unsupervised Learning of Video Representations using LSTMs
- struc2vec: Learning Node Representations from Structural Identity
- Adversarial Feature Learning
- Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering
- Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmark
- TransNets: Learning to Transform for Recommendation
- Distributed and parallel time series feature extraction for industrial big data applications
- Unsupervised Learning by Predicting Noise
- Winner-Take-All Autoencoders
- k-Sparse Autoencoders
- Fast Conical Hull Algorithms for Near-separable Non-negative Matrix Factorization
- Learning From Hidden Traits: Joint Factor Analysis and Latent Clustering
- m-TSNE: A Framework for Visualizing High-Dimensional Multivariate Time Series