Using Complex Networks to Quantify Consistency in the Use of Words

Abstract

In this paper we quantify the consistency of word usage in written texts represented by complex networks, where words were taken as nodes, by measuring the degree of preservation of the node neighborhood.} Words were considered highly consistent if the authors used them with the same neighborhood. When ranked according to the consistency of use, the words obeyed a log-normal distribution, in contrast to the Zipf's law that applies to the frequency of use. Consistency correlated positively with the familiarity and frequency of use, and negatively with ambiguity and age of acquisition. An inspection of some highly consistent words confirmed that they are used in very limited semantic contexts. A comparison of consistency indices for 8 authors indicated that these indices may be employed for author recognition. Indeed, as expected authors of novels could be distinguished from those who wrote scientific texts. Our analysis demonstrated the suitability of the consistency indices, which can now be applied in other tasks, such as emotion recognition.

References in corpus (12)

• The structure and function of complex networks
• Power-law distributions in empirical data
• Power laws, Pareto distributions and Zipf's law
• Characterization of complex networks: A survey of measurements
• Vertex similarity in networks
• Analyzing and Modeling Real-World Phenomena with Complex Networks: A Survey of Applications
• Sharp transition towards shared vocabularies in multi-agent systems
• Network properties of written human language
• Importance of interlinguistic similarity and stable bilingualism when two languages compete
• Comparing intermittency and network measurements of words and their dependency on authorship
• Generic modes of consensus formation in stochastic language dynamics
• Lexical evolution rates by automated stability measure

Cited by in corpus (4)

• Probing the statistical properties of unknown texts: application to the Voynich Manuscript
• Multiplex networks quantify robustness of the mental lexicon to catastrophic concept failures, aphasic degradation and ageing
• Unveiling the relationship between complex networks metrics and word senses
• Analytic solution of a model of language competition with bilingualism and interlinguistic similarity