Structure-semantics interplay in complex networks and its effects on the predictability of similarity in texts

Abstract

There are different ways to define similarity for grouping similar texts into clusters, as the concept of similarity may depend on the purpose of the task. For instance, in topic extraction similar texts mean those within the same semantic field, whereas in author recognition stylistic features should be considered. In this study, we introduce ways to classify texts employing concepts of complex networks, which may be able to capture syntactic, semantic and even pragmatic features. The interplay between the various metrics of the complex networks is analyzed with three applications, namely identification of machine translation (MT) systems, evaluation of quality of machine translated texts and authorship recognition. We shall show that topological features of the networks representing texts can enhance the ability to identify MT systems in particular cases. For evaluating the quality of MT texts, on the other hand, high correlation was obtained with methods capable of capturing the semantics. This was expected because the golden standards used are themselves based on word co-occurrence. Notwithstanding, the Katz similarity, which involves semantic and structure in the comparison of texts, achieved the highest correlation with the NIST measurement, indicating that in some cases the combination of both approaches can improve the ability to quantify quality in MT. In authorship recognition, again the topological features were relevant in some contexts, though for the books and authors analyzed good results were obtained with semantic features as well. Because hybrid approaches encompassing semantic and topological features have not been extensively used, we believe that the methodology proposed here may be useful to enhance text classification considerably, as it combines well-established strategies.

References in corpus (5)

• Estimating Continuous Distributions in Bayesian Classifiers
• Characterization of complex networks: A survey of measurements
• Vertex similarity in networks
• Strong correlations between text quality and complex networks features
• Wikipedia information flow analysis reveals the scale-free architecture of the Semantic Space

Cited by in corpus (18)

• Word sense disambiguation: a complex network approach
• Probing the topological properties of complex networks modeling short written texts
• Knowledge Acquisition: A Complex Networks Approach
• Extractive Multi-document Summarization Using Multilayer Networks
• Text-mining forma mentis networks reconstruct public perception of the STEM gender gap in social media
• Authorship recognition via fluctuation analysis of network topology and word intermittency
• Authorship Attribution Based on Life-Like Network Automata
• On the role of words in the network structure of texts: application to authorship attribution
• In narrative texts punctuation marks obey the same statistics as words
• Representation of texts as complex networks: a mesoscopic approach
• Writing about COVID-19 vaccines: Emotional profiling unravels how mainstream and alternative press framed AstraZeneca, Pfizer and vaccination campaigns
• The Dynamics of Knowledge Acquisition via Self-Learning in Complex Networks
• Labelled network subgraphs reveal stylistic subtleties in written texts
• Predicting language diversity with complex network
• Complex systems: features, similarity and connectivity
• An Image Analysis Approach to the Calligraphy of Books
• Discriminating word senses with tourist walks in complex networks
• Language Networks: a Practical Approach