Information theory for non-stationary processes with stationary increments

Abstract

We describe how to analyze the wide class of non stationary processes with stationary centered increments using Shannon information theory. To do so, we use a practical viewpoint and define ersatz quantities from time-averaged probability distributions. These ersatz versions of entropy, mutual information and entropy rate can be estimated when only a single realization of the process is available. We abundantly illustrate our approach by analyzing Gaussian and non-Gaussian self-similar signals, as well as multi-fractal signals. Using Gaussian signals allow us to check that our approach is robust in the sense that all quantities behave as expected from analytical derivations. Using the stationarity (independence on the integration time) of the ersatz entropy rate, we show that this quantity is not only able to fine probe the self-similarity of the process but also offers a new way to quantify the multi-fractality.

References in corpus (10)

• Estimating Mutual Information
• A multifractal random walk
• Multifractal stationary random measures and multifractal random walks with log-infinitely divisible scaling laws
• Assessing coupling dynamics from an ensemble of time series
• Imprints of log-periodic self-similarity in the stock market
• A phenomenological theory of Eulerian and Lagrangian velocity fluctuations in turbulent flows
• A Kullback-Leibler divergence measure of intermittency: application to turbulence
• Scaling of Information in Turbulence
• Information Theory to probe Intrapartum Fetal Heart Rate Dynamics
• Probing high order dependencies with information theory

Cited by in corpus (4)

• Distance to healthy cardiovascular dynamics from fetal heart rate scale-dependent features in pregnant sheep model of human labor predicts cardiovascular decompensation
• Preliminaries on the Accurate Estimation of the Hurst Exponent Using Time Series
• Quantifying Non-Stationarity with Information Theory
• Traffic Flows Analysis in High-Speed Computer Networks Using Time Series