Feature Selection for Multivariate Time Series via Network Pruning

Abstract

In recent years, there has been an ever increasing amount of multivariate time series (MTS) data in various domains, typically generated by a large family of sensors such as wearable devices. This has led to the development of novel learning methods on MTS data, with deep learning models dominating the most recent advancements. Prior literature has primarily focused on designing new network architectures for modeling temporal dependencies within MTS. However, a less studied challenge is associated with high dimensionality of MTS data. In this paper, we propose a novel neural component, namely Neural Feature Selector (NFS), as an end-2-end solution for feature selection in MTS data. Specifically, NFS is based on decomposed convolution design and includes two modules: firstly each feature stream (a stream corresponds to an univariate series of MTS) within MTS is processed by a temporal CNN independently; then an aggregating CNN combines the processed streams to produce input for other downstream networks. We evaluated the proposed NFS model on four real-world MTS datasets and found that it achieves comparable results with state-of-the-art methods while providing the benefit of feature selection. Our paper also highlights the robustness and effectiveness of feature selection with NFS compared to using recent autoencoder-based methods.

arXiv commentIn ICDM 2021 Workshop on Systematic Feature Engineering for Time-Series Data Mining (SFE-TSDM)

References in corpus (7)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Deep learning for time series classification: a review
• Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
• Multi-Scale Convolutional Neural Networks for Time Series Classification
• A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
• Unsupervised Scalable Representation Learning for Multivariate Time Series
• Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting