Information-theoretic analysis of temporal dependence in discrete stochastic processes: Application to precipitation predictability
arXiv:2510.11276 · doi:10.1063/5.0307092
Abstract
Understanding the temporal dependence of precipitation is key to improving weather predictability and developing efficient stochastic rainfall models. We introduce an information-theoretic approach to quantify memory effects in discrete stochastic processes and apply it to daily precipitation records across the contiguous United States. The method is based on the predictability gain, a quantity derived from block entropy that measures the additional information provided by higher-order temporal dependencies. This statistic, combined with a bootstrap-based hypothesis testing and Fisher's method, enables a robust memory estimator from finite data. Tests with generated sequences show that this estimator outperforms other model-selection criteria such as Akaike Information Criterion and Bayesian Information Criterion. Applied to precipitation data, the analysis reveals that daily rainfall occurrence is well described by low-order Markov chains, exhibiting regional and seasonal variations, with stronger correlations in winter along the West Coast and in summer in the Southeast, consistent with known climatological patterns. Overall, our findings establish a framework for building parsimonious stochastic descriptions, useful when addressing spatial heterogeneity in the memory structure of precipitation dynamics, and support further advances in real-time, data-driven forecasting schemes.
References in corpus (6)
- Entropy and information in neural spike trains: Progress on the sampling problem
- Detecting Memory and Structure in Human Navigation Patterns Using Markov Chain Models of Varying Order
- Entropy estimates of small data sets
- Inferring Markov Chains: Bayesian Estimation, Model Comparison, Entropy Rate, and Out-of-class Modeling
- Inference of entropies of discrete random variables with unknown cardinalities
- Entropy estimators for Markovian sequences: A comparative analysis