Paragraph-based complex networks: application to document classification and authenticity verification

Abstract

With the increasing number of texts made available on the Internet, many applications have relied on text mining tools to tackle a diversity of problems. A relevant model to represent texts is the so-called word adjacency (co-occurrence) representation, which is known to capture mainly syntactical features of texts.In this study, we introduce a novel network representation that considers the semantic similarity between paragraphs. Two main properties of paragraph networks are considered: (i) their ability to incorporate characteristics that can discriminate real from artificial, shuffled manuscripts and (ii) their ability to capture syntactical and semantic textual features. Our results revealed that real texts are organized into communities, which turned out to be an important feature for discriminating them from artificial texts. Interestingly, we have also found that, differently from traditional co-occurrence networks, the adopted representation is able to capture semantic features. Additionally, the proposed framework was employed to analyze the Voynich manuscript, which was found to be compatible with texts written in natural languages. Taken together, our findings suggest that the proposed methodology can be combined with traditional network models to improve text classification tasks.

References in corpus (21)

• Finding and evaluating community structure in networks
• Power laws, Pareto distributions and Zipf's law
• Characterization of complex networks: A survey of measurements
• LexRank: Graph-based Lexical Centrality as Salience in Text Summarization
• A systematic comparison of supervised classifiers
• Network properties of written human language
• Using network science and text analytics to produce surveys in a scientific topic
• A complex network approach to stylometry
• Probing the topological properties of complex networks modeling short written texts
• Authorship Attribution through Function Word Adjacency Networks
• Probing the statistical properties of unknown texts: application to the Voynich Manuscript
• Classifying informative and imaginative prose using complex networks
• Comparing the writing style of real and artificial papers
• Word sense disambiguation via high order of learning in complex networks
• Concentric network symmetry grasps authors' styles in word adjacency networks
• Identification of Literary Movements Using Complex Networks to Represent Texts
• Comparing intermittency and network measurements of words and their dependency on authorship
• Representation of texts as complex networks: a mesoscopic approach
• Topic segmentation via community detection in complex networks
• Concentric Network Symmetry
• An Image Analysis Approach to the Calligraphy of Books

Cited by in corpus (5)

• Text-mining forma mentis networks reconstruct public perception of the STEM gender gap in social media
• Writing about COVID-19 vaccines: Emotional profiling unravels how mainstream and alternative press framed AstraZeneca, Pfizer and vaccination campaigns
• Forma mentis networks reconstruct how Italian high schoolers and international STEM experts perceive teachers, students, scientists, and school
• Semantic flow in language networks
• Text characterization based on recurrence networks