Non-parametric power-law surrogates

Abstract

Power-law distributions are essential in computational and statistical investigations of extreme events and complex systems. The usual technique to generate power-law distributed data is to first infer the scale exponent $\alpha$ using the observed data of interest and then sample from the associated distribution. This approach has important limitations because it relies on a fixed $\alpha$ (e.g., it has limited applicability in testing the {\it family} of power-law distributions) and on the hypothesis of independent observations (e.g., it ignores temporal correlations and other constraints typically present in complex systems data). Here we propose a constrained surrogate method that overcomes these limitations by choosing uniformly at random from a set of sequences exactly as likely to be observed under a discrete power-law as the original sequence (i.e., regardless of $\alpha$) and by showing how additional constraints can be imposed in the sequence (e.g., the Markov transition probability between states). This non-parametric approach involves redistributing observed prime factors to randomize values in accordance with a power-law model but without restricting ourselves to independent observations or to a particular $\alpha$. We test our results in simulated and real data, ranging from the intensity of earthquakes to the number of fatalities in disasters.

arXiv comment16 pages, 12 figures (main manuscript); 8 pages, 7 figures (supplemental material); For code, see https://github.com/JackMurdochMoore/power-law

References in corpus (27)

• Emergence of scaling in random networks
• Power-law distributions in empirical data
• Power laws, Pareto distributions and Zipf's law
• Improved surrogate data for nonlinearity tests
• Surrogate time series
• Scale-free networks are rare
• Problems with Fitting to the Power-Law Distribution
• Unified Scaling Law for Earthquakes
• Long-Term Clustering, Scaling, and Universality in the Temporal Occurrence of Earthquakes
• Nonlinear time-series analysis revisited
• On the Frequency of Severe Terrorist Events
• Interdisciplinary application of nonlinear time series methods
• Universal Fluctuations in Correlated Systems
• Tail Risk of Contagious Diseases
• Constrained-Realization Monte-Carlo Method for Hypothesis Testing
• Parameter estimation for power-law distributions by maximum likelihood methods
• Scale-free Networks Well Done
• Test your surrogate data before you test for nonlinearity
• Power-law size distributions in geoscience revisited
• True scale-free networks hidden by finite size effects
• Fitting Power-laws in empirical data with estimators that work for all exponents
• Testing statistical laws in complex systems
• Scaling and correlations in the dynamics of forest-fire occurrence
• Statically Transformed Autoregressive Process and Surrogate Data Test for Nonlinearity
• Identifying time dependence in network growth
• How likely is an i.i.d. degree sequence to be graphical?
• Tail of the distribution of fatalities in epidemics