Model-free quantification of time-series predictability

Abstract

This paper provides insight into when, why, and how forecast strategies fail when they are applied to complicated time series. We conjecture that the inherent complexity of real-world time-series data---which results from the dimension, nonlinearity, and non-stationarity of the generating process, as well as from measurement issues like noise, aggregation, and finite data length---is both empirically quantifiable and directly correlated with predictability. In particular, we argue that redundancy is an effective way to measure complexity and predictive structure in an experimental time series and that weighted permutation entropy is an effective way to estimate that redundancy. To validate these conjectures, we study 120 different time-series data sets. For each time series, we construct predictions using a wide variety of forecast models, then compare the accuracy of the predictions with the permutation entropy of that time series. We use the results to develop a model-free heuristic that can help practitioners recognize when a particular prediction method is not well matched to the task at hand: that is, when the time series has more predictive structure than that method can capture and exploit.

23 pages, 8 figures, 1 table

References in corpus (2)

• Computational Mechanics: Pattern and Prediction, Structure and Simplicity
• Predictability: a way to characterize Complexity

Cited by in corpus (12)

• Multivariate Dependence Beyond Shannon Information
• Permutation Jensen-Shannon distance: A versatile and fast symbolic tool for complex time series analysis
• Anomaly Detection in Paleoclimate Records using Permutation Entropy
• A new method for choosing parameters in delay reconstruction-based forecast strategies
• Prediction in Projection
• Duality between predictability and reconstructability in complex systems
• Fisher Information Framework for Time Series Modeling
• Delay Parameter Selection in Permutation Entropy Using Topological Data Analysis
• Climate entropy production recorded in a deep Antarctic ice core
• On the predictability of infectious disease outbreaks
• Detection of Local Mixing in Time-Series Data Using Permutation Entropy
• Multivariate time series approximation by multiple trajectories of a dynamical system. Applications to Internet traffic and COVID-19 data