Complex networks analysis of language complexity

Abstract

Methods from statistical physics, such as those involving complex networks, have been increasingly used in quantitative analysis of linguistic phenomena. In this paper, we represented pieces of text with different levels of simplification in co-occurrence networks and found that topological regularity correlated negatively with textual complexity. Furthermore, in less complex texts the distance between concepts, represented as nodes, tended to decrease. The complex networks metrics were treated with multivariate pattern recognition techniques, which allowed us to distinguish between original texts and their simplified versions. For each original text, two simplified versions were generated manually with increasing number of simplification operations. As expected, distinction was easier for the strongly simplified versions, where the most relevant metrics were node strength, shortest paths and diversity. Also, the discrimination of complex texts was improved with higher hierarchical network metrics, thus pointing to the usefulness of considering wider contexts around the concepts. Though the accuracy rate in the distinction was not as high as in methods using deep linguistic knowledge, the complex network approach is still useful for a rapid screening of texts whenever assessing complexity is essential to guarantee accessibility to readers with limited reading ability

The Supplementary Information (SI) is available from https://dl.dropbox.com/u/2740286/supplementary.pdf

References in corpus (4)

• Network Physiology reveals relations between network topology and physiological function
• Identification of Literary Movements Using Complex Networks to Represent Texts
• Comparing intermittency and network measurements of words and their dependency on authorship
• What's in a name?

Cited by in corpus (18)

• Using network science and text analytics to produce surveys in a scientific topic
• Text authorship identified using the dynamics of word co-occurrence networks
• A complex network approach to stylometry
• Probing the topological properties of complex networks modeling short written texts
• Classifying informative and imaginative prose using complex networks
• Comparing the writing style of real and artificial papers
• Using word embeddings to improve the discriminability of co-occurrence text networks
• Concentric network symmetry grasps authors' styles in word adjacency networks
• Authorship recognition via fluctuation analysis of network topology and word intermittency
• Authorship Attribution Based on Life-Like Network Automata
• Topic segmentation via community detection in complex networks
• Network analysis of named entity co-occurrences in written texts
• Analyzing the relationship between text features and research proposal productivity
• Semantic flow in language networks
• Complex systems: features, similarity and connectivity
• Comparing the impact of subfields in scientific journals
• A perspective on the advancement of natural language processing tasks via topological analysis of complex networks
• Average shortest-path length in word-adjacency networks: Chinese versus English