On Mini-Batch Training with Varying Length Time Series

Abstract

In real-world time series recognition applications, it is possible to have data with varying length patterns. However, when using artificial neural networks (ANN), it is standard practice to use fixed-sized mini-batches. To do this, time series data with varying lengths are typically normalized so that all the patterns are the same length. Normally, this is done using zero padding or truncation without much consideration. We propose a novel method of normalizing the lengths of the time series in a dataset by exploiting the dynamic matching ability of Dynamic Time Warping (DTW). In this way, the time series lengths in a dataset can be set to a fixed size while maintaining features typical to the dataset. In the experiments, all 11 datasets with varying length time series from the 2018 UCR Time Series Archive are used. We evaluate the proposed method by comparing it with 18 other length normalization methods on a Convolutional Neural Network (CNN), a Long-Short Term Memory network (LSTM), and a Bidirectional LSTM (BLSTM).

arXiv commentAccepted to ICASSP 2022

References in corpus (6)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• An overview of gradient descent optimization algorithms
• An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
• An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks
• Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
• Time series classification for varying length series