Complex systems approach to natural language
arXiv:2401.02772 · doi:10.1016/j.physrep.2023.12.002
Abstract
The review summarizes the main methodological concepts used in studying natural language from the perspective of complexity science and documents their applicability in identifying both universal and system-specific features of language in its written representation. Three main complexity-related research trends in quantitative linguistics are covered. The first part addresses the issue of word frequencies in texts and demonstrates that taking punctuation into consideration restores scaling whose violation in the Zipf's law is often observed for the most frequent words. The second part introduces methods inspired by time series analysis, used in studying various kinds of correlations in written texts. The related time series are generated on the basis of text partition into sentences or into phrases between consecutive punctuation marks. It turns out that these series develop features often found in signals generated by complex systems, like long-range correlations or (multi)fractal structures. Moreover, it appears that the distances between punctuation marks comply with the discrete variant of the Weibull distribution. In the third part, the application of the network formalism to natural language is reviewed, particularly in the context of the so-called word-adjacency networks. Parameters characterizing topology of such networks can be used for classification of texts, for example, from a stylometric perspective. Network approach can also be applied to represent the organization of word associations. Structure of word-association networks turns out to be significantly different from that observed in random networks, revealing genuine properties of language. Finally, punctuation seems to have a significant impact not only on the language's information-carrying ability but also on its key statistical properties, hence it is recommended to consider punctuation marks on a par with words.
arXiv comment113 pages, 49 figures
References in corpus (68)
- Emergence of scaling in random networks
- Fast unfolding of communities in large networks
- Statistical mechanics of complex networks
- Power-law distributions in empirical data
- Epidemic spreading in scale-free networks
- Power laws, Pareto distributions and Zipf's law
- The architecture of complex weighted networks
- Epidemic processes in complex networks
- Multifractal detrended fluctuation analysis of nonstationary time series
- The spread of epidemic disease on networks
- Quantifying social group evolution
- Self-similar community structure in organisations
- Self-similarity of complex networks
- Detecting Long-range Correlations with Detrended Fluctuation Analysis
- The Web of Human Sexual Contacts
- Emergent complex neural dynamics
- Scale-Free Networks are Ultrasmall
- Origins of fractality in the growth of complex networks
- The Matthew effect in empirical data
- How to calculate the fractal dimension of a complex network: the box covering algorithm
- Critical Market Crashes
- Wavelet versus Detrended Fluctuation Analysis of multifractal structures
- Average path length in random networks
- Average path length in uncorrelated random networks with hidden variables
- Beyond the Zipf-Mandelbrot law in quantitative linguistics
- Critical brain networks
- Power laws and Self-Organized Criticality in Theory and Nature
- Scaling Behaviour of Developing and Decaying Networks
- Multiscale characteristics of the emerging global cryptocurrency market
- Skeleton and fractal scaling in complex networks
- An integrated approach to the assessment of long range correlation in time series data
- Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words
- Quantitative features of multifractal subtleties in time series
- Statistical physics approaches to the complex Earth system
- Detecting and interpreting distortions in hierarchical organization of complex time series
- Multifractality in the stock market: price increments versus waiting times
- Components of multifractality in high-frequency stock returns
- Zipf's Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems
- Weighted Assortative And Disassortative Networks Model
- Scale-free trees: the skeletons of complex networks
- The Single Big Jump Principle in Physical Modelling
- Estimating the entropy of binary time series: Methodology, some theory and a simulation study
- Complexity in economic and social systems: cryptocurrency market at around COVID-19
- Generalized Hurst exponent and multifractal function of original and translated texts mapped into frequency and length time series
- Statistical laws in linguistics
- Zipf's law for word frequencies: word forms versus lemmas in long texts
- Genuine multifractality in time series is due to temporal correlations
- Adaptation to the Edge of Chaos in the Self-Adjusting Logistic Map
- Linguistic data mining with complex networks: a stylometric-oriented approach
- In narrative texts punctuation marks obey the same statistics as words
- Transport in disordered systems: the single big jump approach
- Effective Complexity and its Relation to Logical Depth
- Modeling the average shortest path length in growth of word-adjacency networks
- The brevity law as a scaling law, and a possible origin of Zipf's law for word frequencies
- How incomputable is Kolmogorov complexity?
- Microscopic activity patterns in the Naming Game
- Evolution of Vocabulary on Scale-free and Random Networks
- Analysis of English free association network reveals mechanisms of efficient solution of Remote Association Tests
- Equilibrium (Zipf) and Dynamic (Grasseberg-Procaccia) method based analyses of human texts. A comparison of natural (english) and artificial (esperanto) languages
- Investigation of the Zipf-plot of the extinct Meroitic language
- Life at the edge: complexity and criticality in biological function
- Hierarchical organization of H. Eugene Stanley scientific collaboration community in weighted network representation
- Universal versus system-specific features of punctuation usage patterns in~major Western~languages
- Comparative Computational Analysis of Global Structure in Canonical, Non-Canonical and Non-Literary Texts
- A simple branching model that reproduces language family and language population distributions
- Text characterization based on recurrence networks
- Two halves of a meaningful text are statistically different
- Universal features of mountain ridge networks on Earth
Cited by in corpus (12)
- Disentangling sources of multifractality in time series
- Statistics of punctuation in experimental literature -- the remarkable case of "Finnegans Wake" by James Joyce
- Entropy and type-token ratio in gigaword corpora
- Multifractal hopscotch in "Hopscotch" by Julio Cortazar
- Punctuation patterns in "Finnegans Wake" by James Joyce are largely translation-invariant
- Language statistics at different spatial, temporal, and grammatical scales
- Quantifying patterns of punctuation in modern Chinese prose
- Average shortest-path length in word-adjacency networks: Chinese versus English
- Study of scaling laws in language families
- Quadratic Term Correction on Heaps' Law
- A Zipf-preserving, long-range correlated surrogate for written language and other symbolic sequences
- Computational lexical analysis of Flamenco genres