A Shapelet-based Framework for Unsupervised Multivariate Time Series Representation Learning
arXiv:2305.18888 · doi:10.14778/3632093.3632103
Abstract
Recent studies have shown great promise in unsupervised representation learning (URL) for multivariate time series, because URL has the capability in learning generalizable representation for many downstream tasks without using inaccessible labels. However, existing approaches usually adopt the models originally designed for other domains (e.g., computer vision) to encode the time series data and {rely on strong assumptions to design learning objectives, which limits their ability to perform well}. To deal with these problems, we propose a novel URL framework for multivariate time series by learning time-series-specific shapelet-based representation through a popular contrasting learning paradigm. To the best of our knowledge, this is the first work that explores the shapelet-based embedding in the unsupervised general-purpose representation learning. A unified shapelet-based encoder and a novel learning objective with multi-grained contrasting and multi-scale alignment are particularly designed to achieve our goal, and a data augmentation library is employed to improve the generalization. We conduct extensive experiments using tens of real-world datasets to assess the representation quality on many downstream tasks, including classification, clustering, and anomaly detection. The results demonstrate the superiority of our method against not only URL competitors, but also techniques specially designed for downstream tasks. Our code has been made publicly available at https://github.com/real2fish/CSL.
Accepted by VLDB 2024, 14 pages
References in corpus (7)
- Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
- Multivariate LSTM-FCNs for Time Series Classification
- GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training
- An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks
- Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networks
- Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency
- Dynamic Sparse Network for Time Series Classification: Learning What to "see''