Word statistics in Blogs and RSS feeds: Towards empirical universal evidence

Abstract

We focus on the statistics of word occurrences and of the waiting times between such occurrences in Blogs. Due to the heterogeneity of words' frequencies, the empirical analysis is performed by studying classes of "frequently-equivalent" words, i.e. by grouping words depending on their frequencies. Two limiting cases are considered: the dilute limit, i.e. for those words that are used less than once a day, and the dense limit for frequent words. In both cases, extreme events occur more frequently than expected from the Poisson hypothesis. These deviations from Poisson statistics reveal non-trivial time correlations between events that are associated with bursts of activities. The distribution of waiting times is shown to behave like a stretched exponential and to have the same shape for different sets of words sharing a common frequency, thereby revealing universal features.

16 pages, 6 figures

References in corpus (8)

• The origin of bursts and heavy tails in human dynamics
• Modeling bursts and heavy tails in human dynamics
• Novelty and Collective Attention
• A Yule-Simon process with memory
• A Brownian particle having a fluctuating mass
• Exact Solutions for Network Rewiring Models
• Endo- vs. Exo-genous shocks and relaxation rates in book and music "sales"
• Time-evolving distribution of time lags between commercial airline disasters