Complexity-entropy analysis at different levels of organization in written language
arXiv:1903.07416 · doi:10.1371/journal.pone.0214863
Abstract
Written language is complex. A written text can be considered an attempt to convey a meaningful message which ends up being constrained by language rules, context dependence and highly redundant in its use of resources. Despite all these constraints, unpredictability is an essential element of natural language. Here we present the use of entropic measures to assert the balance between predictability and surprise in written text. In short, it is possible to measure innovation and context preservation in a document. It is shown that this can also be done at the different levels of organization of a text. The type of analysis presented is reasonably general, and can also be used to analyze the same balance in other complex messages such as DNA, where a hierarchy of organizational levels are known to exist.
References in corpus (13)
- Entropy estimation of symbol sequences
- History of art paintings through the lens of entropy and complexity
- The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing
- On the origin of long-range correlations in texts
- A complex network approach to stylometry
- Probing the topological properties of complex networks modeling short written texts
- Probing the statistical properties of unknown texts: application to the Voynich Manuscript
- Towards the quantification of the semantic information encoded in written language
- On the non-randomness of maximum Lempel Ziv complexity sequences of finite size
- Excess entropy in natural language: present state and perspectives
- Analysis of the phase transition in the Ising ferromagnet using a Lempel-Ziv string parsing scheme and black-box data-compression utilities
- Lempel-Ziv complexity analysis of one dimensional cellular automata
- The predictability of letters in written english