Effect of extreme data loss on long-range correlated and anti-correlated signals quantified by detrended fluctuation analysis

Abstract

We investigate how extreme loss of data affects the scaling behavior of long-range power-law correlated and anti-correlated signals applying the DFA method. We introduce a segmentation approach to generate surrogate signals by randomly removing data segments from stationary signals with different types of correlations. These surrogate signals are characterized by: (i) the DFA scaling exponent $\alpha$ of the original correlated signal, (ii) the percentage $p$ of the data removed, (iii) the average length $\mu$ of the removed (or remaining) data segments, and (iv) the functional form of the distribution of the length of the removed (or remaining) data segments. We find that the {\it global} scaling exponent of positively correlated signals remains practically unchanged even for extreme data loss of up to 90%. In contrast, the global scaling of anti-correlated signals changes to uncorrelated behavior even when a very small fraction of the data is lost. These observations are confirmed on the examples of human gait and commodity price fluctuations. We systematically study the {\it local} scaling behavior of signals with missing data to reveal deviations across scales. We find that for anti-correlated signals even 10% of data loss leads to deviations in the local scaling at large scales from the original anti-correlated towards uncorrelated behavior. In contrast, positively correlated signals show no observable changes in the local scaling for up to 65% of data loss, while for larger percentage, the local scaling shows overestimated regions (with higher local exponent) at small scales, followed by underestimated regions (with lower local exponent) at large scales. Finally, we investigate how the scaling is affected by the statistics of the remaining data segments in comparison to the removed segments.

References in corpus (25)

• Detecting Long-range Correlations with Detrended Fluctuation Analysis
• Effect of Trends on Detrended Fluctuation Analysis
• Effect of nonstationarities on detrended fluctuation analysis
• The statistical properties of the volatility of price fluctuations
• Method for Generating Long-Range Correlations for Large Systems
• Magnitude and Sign Correlations in Heartbeat Fluctuations
• Comparison of detrending methods for fluctuation analysis
• Correlations in Economic Time Series
• Quantifying signals with power-law correlations: A comparative study of detrended fluctuation analysis and detrended moving average techniques
• Effect of nonlinear filters on detrended fluctuation analysis
• Stochastic Feedback and the Regulation of Biological Rhythms
• Sleep-Wake Differences in Scaling Behavior of the Human Heartbeat: Analysis of Terrestrial and Long-Term Space Flight Data
• Characterization of Sleep Stages by Correlations of Heartbeat Increments
• A Stochastic Model of Human Gait Dynamics
• Common Scaling Patterns in Intertrade Times of U. S. Stocks
• Scale Invariance and Nonlinear Patterns of Human Activity
• Long term persistence in the sea surface temperature fluctuations
• Correlation Differences in Heartbeat Fluctuations During Rest and Exercise
• Fractal scale-invariant and nonlinear properties of cardiac dynamics remain stable with advanced age: A new mechanistic picture of cardiac control in healthy elderly
• Detrended fluctuation analysis of the magnetic and electric field variations that precede rupture
• Power law correlations in the Southern Oscillation Index fluctuations characterizing El Nino
• Isochores Merit the Prefix 'Iso'
• Volatility in the Italian Stock Market: an Empirical Study
• Correlations Between Reconstructed EUR Exchange Rates vs. CHF, DKK, GBP, JPY and USD
• Effect of coarse-graining on detrended fluctuation analysis

Cited by in corpus (21)

• Multifractal analysis of financial markets
• Multifractal detrending moving average cross-correlation analysis
• Testing the weak-form efficiency of the WTI crude oil futures market
• Establishing a direct connection between detrended fluctuation analysis and Fourier analysis
• Theoretical foundation of detrending methods for fluctuation analysis such as detrended fluctuation analysis and detrending moving average
• Detrending Moving Average Algorithm: Frequency Response and Scaling Performances
• Effects of coarse-graining on the scaling behavior of long-range correlated and anti-correlated signals
• Extreme value statistics and recurrence intervals of NYMEX energy futures volatility
• Effects of polynomial trends on detrending moving average analysis
• Effect of significant data loss on identifying electric signals that precede rupture by detrended fluctuation analysis in natural time
• Assessment of long-range correlation in animal behaviour time series: the temporal pattern of locomotor activity of Japanese quail (Coturnix coturnix) and mosquito larva (Culex quinquefasciatus)
• Correlated power time series of individual wind turbines: A data driven model approach
• Early Warning Signals Indicate a Critical Transition in Betelgeuse
• Multifractal Analysis of Pulsar Timing Residuals: Assessment of Gravitational Wave Detection
• Probabilistic properties of detrended fluctuation analysis for Gaussian processes
• Linear and nonlinear correlations in order aggressiveness of Chinese stocks
• How Does ENSO Impact the Solar Radiation Forecast in South America? The Self-affinity Analysis Approach
• Inferring long memory using extreme events
• Time Series Analysis of Photospheric Magnetic Parameters of Flare-quiet versus Flaring Active Regions: Scaling Properties of Fluctuations
• Dual-induced multifractality in online viewing activity
• Homology Groups of Embedded Fractional Brownian Motion