Evaluation of deep learning models for multi-step ahead time series prediction

Abstract

Time series prediction with neural networks has been the focus of much research in the past few decades. Given the recent deep learning revolution, there has been much attention in using deep learning models for time series prediction, and hence it is important to evaluate their strengths and weaknesses. In this paper, we present an evaluation study that compares the performance of deep learning models for multi-step ahead time series prediction. The deep learning methods comprise simple recurrent neural networks, long short-term memory (LSTM) networks, bidirectional LSTM networks, encoder-decoder LSTM networks, and convolutional neural networks. We provide a further comparison with simple neural networks that use stochastic gradient descent and adaptive moment estimation (Adam) for training. We focus on univariate time series for multi-step-ahead prediction from benchmark time-series datasets and provide a further comparison of the results with related methods from the literature. The results show that the bidirectional and encoder-decoder LSTM network provides the best performance in accuracy for the given time series problems.

References in corpus (8)

• Adam: A Method for Stochastic Optimization
• Deep Learning in Neural Networks: An Overview
• Sequence to Sequence Learning with Neural Networks
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Playing Atari with Deep Reinforcement Learning
• Multi-Step-Ahead Time Series Prediction using Multiple-Output Support Vector Regression
• Predictive State Recurrent Neural Networks

Cited by in corpus (7)

• Bayesian neural networks via MCMC: a Python-based tutorial
• FedMUP: Federated Learning driven Malicious User Prediction Model for Secure Data Distribution in Cloud Environments
• Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams
• MAIDS: Malicious Agent Identification-based Data Security Model for Cloud Environments
• Blockchain Transaction Fee Forecasting: A Comparison of Machine Learning Methods
• A case study of spatiotemporal forecasting techniques for weather forecasting
• RACH Traffic Prediction in Massive Machine Type Communications