Semantic flow in language networks
arXiv:1905.07595 · doi:10.1016/j.physa.2020.124895
Abstract
In this study we propose a framework to characterize documents based on their semantic flow. The proposed framework encompasses a network-based model that connected sentences based on their semantic similarity. Semantic fields are detected using standard community detection methods. as the story unfolds, transitions between semantic fields are represent in Markov networks, which in turned are characterized via network motifs (subgraphs). Here we show that the proposed framework can be used to classify books according to their style and publication dates. Remarkably, even without a systematic optimization of parameters, philosophy and investigative books were discriminated with an accuracy rate of 92.5%. Because this model captures semantic features of texts, it could be used as an additional feature in traditional network-based models of texts that capture only syntactical/stylistic information, as it is the case of word adjacency (co-occurrence) networks.
References in corpus (35)
- Scikit-learn: Machine Learning in Python
- Efficient Estimation of Word Representations in Vector Space
- Fast unfolding of communities in large networks
- Distributed Representations of Words and Phrases and their Compositionality
- Finding and evaluating community structure in networks
- Sequence to Sequence Learning with Neural Networks
- Modularity and community structure in networks
- Community detection in graphs
- Natural Language Processing (almost) from Scratch
- Extracting the multiscale backbone of complex weighted networks
- Networks in Cognitive Science
- Statistically validated networks in bipartite complex systems
- Using network science and text analytics to produce surveys in a scientific topic
- Information filtering in complex weighted networks
- Text authorship identified using the dynamics of word co-occurrence networks
- Patterns of authors contribution in scientific manuscripts
- Word sense disambiguation: a complex network approach
- Probing the topological properties of complex networks modeling short written texts
- Knowledge Acquisition: A Complex Networks Approach
- Authorship Attribution through Function Word Adjacency Networks
- Extractive Multi-document Summarization Using Multilayer Networks
- Probing the statistical properties of unknown texts: application to the Voynich Manuscript
- Classifying informative and imaginative prose using complex networks
- Comparing the writing style of real and artificial papers
- Word sense disambiguation via high order of learning in complex networks
- Concentric network symmetry grasps authors' styles in word adjacency networks
- Paragraph-based complex networks: application to document classification and authenticity verification
- Word sense induction using word embeddings and community detection in complex networks
- Identification of Literary Movements Using Complex Networks to Represent Texts
- Complex networks analysis of language complexity
- Representation of texts as complex networks: a mesoscopic approach
- Unveiling the relationship between complex networks metrics and word senses
- Robust clustering of languages across Wikipedia growth
- Connecting Network Science and Information Theory
- Labelled network subgraphs reveal stylistic subtleties in written texts