Tunable robustness in power-law inference
arXiv:2301.05690 · doi:10.1098/rsif.2023.0310
Abstract
Power-law probability distributions arise often in the social and natural sciences. Statistics have been developed for estimating the exponent parameter as well as gauging goodness-of-fit to a power law. Yet paradoxically, many famous power laws such as the distribution of wealth and earthquake magnitudes have not found good statistical support in data by modern methods. We show that measurement errors such as quantization and noise bias both maximum-likelihood estimators and goodness-of-fit measures. We address this issue using logarithmic binning and the corresponding discrete reference distribution for maximum likelihood estimators and Kolmogorov-Smirnov statistics. Using simulated errors, we validate that binning attenuates bias in parameter estimates and recalibrates goodness of fit to a power law by removing small errors from consideration. These benefits come at modest cost in statistical power, which can be compensated with larger sample sizes. We reanalyse three empirical cases of wealth, earthquake magnitudes and wildfire area and show that binning reverses statistical conclusions and aligns the statistical results with historical and scientific expectations. We explain through these cases how routine errors lead to incorrect conclusions and the necessity for more robust methods.
References in corpus (15)
- Emergence of scaling in random networks
- Power-law distributions in empirical data
- Power laws, Pareto distributions and Zipf's law
- Scale-free networks are rare
- Problems with Fitting to the Power-Law Distribution
- Unified Scaling Law for Earthquakes
- Discrete scale invariance and complex dimensions
- On the Frequency of Severe Terrorist Events
- Power-law distributions in binned empirical data
- Parameter estimation for power-law distributions by maximum likelihood methods
- Critical Behaviour of the Drossel-Schwabl Forest Fire Model
- Testing statistical laws in complex systems
- Testing Foundations of Biological Scaling Theory Using Automated Measurements of Vascular Networks
- On a minimum distance procedure for threshold selection in tail analysis
- Tunable robustness in power-law inference