Words ranking and Hirsch index for identifying the core of the hapaxes in political texts
arXiv:2006.07667 · doi:10.1016/j.joi.2020.101054
Abstract
This paper deals with a quantitative analysis of the content of official political speeches. We study a set of about one thousand talks pronounced by the US Presidents, ranging from Washington to Trump. In particular, we search for the relevance of the rare words, i.e. those said only once in each speech -- the so-called hapaxes. We implement a rank-size procedure of Zipf-Mandelbrot type for discussing the hapaxes' frequencies regularity over the overall set of speeches. Starting from the obtained rank-size law, we define and detect the core of the hapaxes set by means of a procedure based on an Hirsch index variant. We discuss the resulting list of words in the light of the overall US Presidents' speeches. We further show that this core of hapaxes itself can be well fitted through a Zipf-Mandelbrot law and that contains elements producing deviations at the low ranks between scatter plots and fitted curve -- the so-called king and vice-roy effect. Some socio-political insights are derived from the obtained findings about the US Presidents messages.
References in corpus (14)
- An index to quantify an individual's scientific research output
- Power laws, Pareto distributions and Zipf's law
- Stretched exponential distributions in Nature and Economy: ``Fat tails'' with characteristic scales
- An index to quantify an individual's scientific research output that takes into account the effect of multiple coauthorship
- Beyond the Zipf-Mandelbrot law in quantitative linguistics
- Generalized Hurst exponent and multifractal function of original and translated texts mapped into frequency and length time series
- Evidence of Economic Regularities and Disparities of Italian Regions From Aggregated Tax Income Size Data
- A universal rank-size law
- A joint text mining-rank size investigation of the rhetoric structures of the US Presidents' speeches
- Quantifying the quality of peer reviewers through Zipf's law
- Equilibrium (Zipf) and Dynamic (Grasseberg-Procaccia) method based analyses of human texts. A comparison of natural (english) and artificial (esperanto) languages
- Punctuation effects in English and Esperanto texts
- The interconnectedness of the economic content in the speeches of the US Presidents
- Coherent measures of the impact of co-authors in peer review journals and in proceedings publications