Surrogate time series
arXiv:chao-dyn/9909037 · doi:10.1016/S0167-2789(00)00043-9
Abstract
Before we apply nonlinear techniques, for example those inspired by chaos theory, to dynamical phenomena occurring in nature, it is necessary to first ask if the use of such advanced techniques is justified "by the data". While many processes in nature seem very unlikely a priori to be linear, the possible nonlinear nature might not be evident in specific aspects of their dynamics. The method of surrogate data has become a very popular tool to address such a question. However, while it was meant to provide a statistically rigorous, foolproof framework, some limitations and caveats have shown up in its practical use. In this paper, recent efforts to understand the caveats, avoid the pitfalls, and to overcome some of the limitations, are reviewed and augmented by new material. In particular, we will discuss specific as well as more general approaches to constrained randomisation, providing a full range of examples. New algorithms will be introduced for unevenly sampled and multivariate data and for surrogate spike trains. The main limitation, which lies in the interpretability of the test results, will be illustrated through instructive case studies. We will also discuss some implementational aspects of the realisation of these methods in the TISEAN (http://www.mpipks-dresden.mpg.de/~tisean) software package.
28 pages, 23 figures, software at http://www.mpipks-dresden.mpg.de/~tisean
References in corpus (7)
- Improved surrogate data for nonlinearity tests
- Practical implementation of nonlinear time series methods: The TISEAN package
- Discrimination power of measures for nonlinearity in a time series
- Constrained randomization of time series data
- Test your surrogate data before you test for nonlinearity
- The power of surrogate data testing with respect to non-stationarity
- Testing for nonlinearity in unevenly sampled time series
Cited by in corpus (123)
- Nonlinear multivariate analysis of Neurophysiological Signals
- Complex network approaches to nonlinear time series analysis
- Nonlinear time-series analysis revisited
- Highly comparative feature-based time-series classification
- Multifractal Properties of Price Fluctuations of Stocks and Commodities
- Coupling functions: Universal insights into dynamical interaction mechanisms
- HERMES: towards an integrated toolbox to characterize functional and effective brain connectivity
- How to avoid potential pitfalls in recurrence plot based data analysis
- Multiscale characteristics of the emerging global cryptocurrency market
- Switchbacks in the near-Sun magnetic field: long memory and impact on the turbulence cascade
- Event coincidence analysis for quantifying statistical interrelationships between event time series: on the role of flood events as possible triggers of epidemic outbreaks
- Characterization of Sleep Stages by Correlations of Heartbeat Increments
- Unified functional network and nonlinear time series analysis for complex systems science: The pyunicorn package
- Nonlinear Mode Decomposition: a new noise-robust, adaptive decomposition method
- Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing
- Entropy in the natural time-domain
- Surrogate-based artifact removal from single-channel EEG
- Critical Scale-invariance in Healthy Human Heart Rate
- Bitcoin market route to maturity? Evidence from return fluctuations, temporal correlations and multiscaling effects
- Hybrid scheme for modeling local field potentials from point-neuron networks
- Persistent and anti-persistent pattern in stride-to-stride variability of treadmill walking: influence of rhythmic auditory cueing
- Testing time series irreversibility using complex network methods
- Disentangling different types of El Niño episodes by evolving climate network analysis
- From brain to earth and climate systems: Small-world interaction networks or not?
- Assortative mixing in functional brain networks during epileptic seizures
- Trends in recurrence analysis of dynamical systems
- Non-linear dependence and teleconnections in climate data: sources, relevance, nonstationarity
- Methods for characterising microphysical processes in plasmas
- A non subjective approach to the GP algorithm for analysing noisy time series
- Indication of multiscaling in the volatility return intervals of stock markets
- Volatility of Linear and Nonlinear Time Series
- Unraveling Spurious Properties of Interaction Networks with Tailored Random Networks
- Inferring species interactions using Granger causality and convergent cross mapping
- Nonlinear Volatility of River Flux Fluctuations
- A Goldilocks principle for modeling radial velocity noise
- Detection of time reversibility in time series by ordinal patterns analysis
- Statically Transformed Autoregressive Process and Surrogate Data Test for Nonlinearity
- A Tutorial on Time-Evolving Dynamical Bayesian Inference
- Detecting abnormality in heart dynamics from multifractal analysis of ECG signals
- Price Clustering and Discreteness: Is there Chaos behind the Noise?
- An Information Theoretic Algorithm for Finding Periodicities in Stellar Light Curves
- Phase space reconstruction from a biological time series. A PhotoPlethysmoGraphic signal a case study
- Analysing Large Scale Structure: I. Weighted Scaling Indices and Constrained Randomisation
- Time reversibility during the ageing of materials
- Chaotic and stochastic processes in the accretion flows of the black hole X-ray binaries revealed by recurrence analysis
- Level Crossing Analysis of the Stock Markets
- Quantifying time irreversibility using probabilistic differences between symmetric permutations
- A stochastic model for heart rate fluctuations
- Constrained Randomisation of Weighted Networks
- Surrogate-assisted analysis of weighted functional brain networks
- Phase space reconstruction for non-uniformly sampled noisy time series
- Revisiting algorithms for generating surrogate time series
- Correlations in magnitude series to assess nonlinearities: application to multifractal models and heartbeat fluctuations
- Testing the assumptions of linear prediction analysis in normal vowels
- A Machine Learning Classifier for Microlensing in Wide-Field Surveys
- Wavelet-based discrimination of isolated singularities masquerading as multifractals in detrended fluctuation analyses
- Introduction to correlation networks: Interdisciplinary approaches beyond thresholding
- Multicanonical MCMC for Sampling Rare Events
- Time-varying coupling functions: dynamical inference and cause of synchronization transitions
- Extreme value statistics and return intervals in long-range correlated uniform deviates
- An experimental study of regime transitions in a differentially heated baroclinic annulus with flat and sloping bottom topographies
- The arrow of time across five centuries of classical music
- Time correlations and 1/f behavior in backscattering radar reflectivity measurements from cirrus cloud ice fluctuations
- Right-side-stretched multifractal spectra indicate small-worldness in networks
- Fatigue Life Estimation of Structures under Statistically and Spectrally Similar Variable Amplitude Loading
- Time-series-analysis-based detection of critical transitions in real-world non-autonomous systems
- Nonlinear time series anaysis of the light curves from the black hole system GRS1915+105
- The dynamics of laser droplet generation
- Features of the extreme events observed in the all-solid state laser with a saturable absorber
- Energy landscape analysis based on the Ising model: Tutorial review
- Multifractal detrended moving average analysis of global temperature records
- Testing for intrinsic multifractality in the global grain spot market indices: A multifractal detrended fluctuation analysis
- Detecting Generalized Synchronization Between Chaotic Signals: A Kernel-based Approach
- Revisiting Evidence of Chaos in X-ray Light Curves: The Case of GRS 1915+105
- Link and subgraph likelihoods in random undirected networks with fixed and partially fixed degree sequence
- The Chaotic Long-term X-ray Variability of 4U 1705--44
- Multifractal organization of EEG signals in Multiple Sclerosis
- Ordinal methods for a characterization of evolving functional brain networks
- Recurrence network measures for hypothesis testing using surrogate data: application to black hole light curves
- Time-energy correlations in solar flare occurrence
- Chaos in computer performance
- Analysing large scale structure: II. Testing for primordial non-Gaussianity in CMB maps using surrogates
- Approaching multifractal complexity in decentralized cryptocurrency trading
- ENSO dynamics: low-dimensional-chaotic or stochastic?
- Analysis of fractional Gaussian noises using level crossing method
- Sampling rate-corrected analysis of irregularly sampled time series
- High-dimensional dynamics in a single-transistor oscillator containing Feynman-Sierpinski resonators: effect of fractal depth and irregularity
- Extreme Events related with spatial patterns in an all-solid-state laser with saturable absorber
- Statistical properties of user activity fluctuations in virtual worlds
- Fluctuation analysis of high frequency electric power load in the Czech Republic
- Statistical analysis of Gene and Intergenic DNA Sequences
- Response of solar irradiance to sunspot area variations
- Identifying low-dimensional dynamics in Type-I edge-localised-mode processes in JET plasmas
- Non-linear behaviour of XTE J1550-564 during its 1998-1999 outburst, revealed by recurrence analysis
- Extended self-similarity of atmospheric boundary layer wind fields in mesoscale regime: Is it real?
- Complex Variability of Kepler AGN Revealed by Recurrence Analysis
- Probing non-Gaussianities in the CMB on an incomplete sky using surrogates
- Coexisting stochastic and coherence resonance in a mean-field dynamo model for Earth's magnetic field reversals
- Non-parametric power-law surrogates
- Recurrence Network Analysis of Exoplanetary Observables
- Delta-alpha cross-frequency coupling for different brain regions
- Investigating Non-linear and Stochastic Hard X-ray Variability of Active Galactic Nuclei using Recurrence Analysis
- Dose-response functions and surrogate models for exploring social contagion in the Copenhagen Networks Study
- Dynamics in cortical activity revealed by resting-state MEG rhythms
- Nonlinear Correlations in Multifractals: Visibility Graphs of Magnitude and Sign Series
- The level crossing and inverse statistic analysis of German stock market index (DAX) and daily oil price time series
- The relation between the statistics of open ocean currents and the temporal correlations of the wind
- Comparative analysis of time irreversibility and amplitude irreversibility based on joint permutation
- Accounting for outliers and calendar effects in surrogate simulations of stock return sequences
- Correlating nonlinear time series and spectral properties of IGR J17091-3624: Is it similar to GRS 1915+105?
- Linearity versus non-linearity in high frequency multilevel wind time series measured in urban areas
- Fuzzy permutation time irreversibility for nonequilibrium analysis of complex system
- Detecting frequency modulation in stochastic time series data
- Phase synchronization of instrumental music signals
- Efficient Coherence Inference Using the Demodulated Band Transform and a Generalized Linear Model
- Chaos in free electron laser oscillators
- Bursts of extensive air showers: chaos vs. stochasticity
- Spectral Ranking of Causal Influence in Complex Systems
- Detecting contagious spreading of urban innovations on the global city network
- Null-Validated Topological Signatures of Financial Market Dynamics
- Causal inference in time series in terms of Rényi transfer entropy
- A novel parameter for nonequilibrium analysis in reconstructed state spaces
- Testing of Binary Regime Switching Models using Squeeze Duration Analysis