Word frequency-rank relationship in tagged texts

Abstract

We analyze the frequency-rank relationship in sub-vocabularies corresponding to three different grammatical classes (nouns, verbs, and others) in a collection of literary works in English, whose words have been automatically tagged according to their grammatical role. Comparing with a null hypothesis which assumes that words belonging to each class are uniformly distributed across the frequency-ranked vocabulary of the whole work, we disclose statistically significant differences between the three classes. This results point to the fact that frequency-rank relationships may reflect linguistic features associated with grammatical function.

References in corpus (5)

• Emergence of scaling in random networks
• Stochastic model for the vocabulary growth in natural languages
• A joint text mining-rank size investigation of the rhetoric structures of the US Presidents' speeches
• Sample space reducing cascading processes produce the full spectrum of scaling exponents
• Words ranking and Hirsch index for identifying the core of the hapaxes in political texts