Deep Gated Recurrent and Convolutional Network Hybrid Model for Univariate Time Series Classification

Abstract

Hybrid LSTM-fully convolutional networks (LSTM-FCN) for time series classification have produced state-of-the-art classification results on univariate time series. We show that replacing the LSTM with a gated recurrent unit (GRU) to create a GRU-fully convolutional network hybrid model (GRU-FCN) can offer even better performance on many time series datasets. The proposed GRU-FCN model outperforms state-of-the-art classification performance in many univariate and multivariate time series datasets. In addition, since the GRU uses a simpler architecture than the LSTM, it has fewer training parameters, less training time, and a simpler hardware implementation, compared to the LSTM-based models.

arXiv commentThe paper modified and has several new results

References in corpus (7)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
• LSTM Fully Convolutional Networks for Time Series Classification
• Multi-Scale Convolutional Neural Networks for Time Series Classification
• Noisy Activation Functions

Cited by in corpus (8)

• Insights into LSTM Fully Convolutional Networks for Time Series Classification
• Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Pens
• Detecting COVID-19 from digitized ECG printouts using 1D convolutional neural networks
• Reduced-Gate Convolutional LSTM Using Predictive Coding for Spatiotemporal Prediction
• Fusing Structure from Motion and Simulation-Augmented Pose Regression from Optical Flow for Challenging Indoor Environments
• Intrusion Detection System in Smart Home Network Using Bidirectional LSTM and Convolutional Neural Networks Hybrid Model
• Toward Affordable and Non-Invasive Detection of Hypoglycemia: A Machine Learning Approach
• FlexParser -- the adaptive log file parser for continuous results in a changing world