Re-evaluating phoneme frequencies
arXiv:2006.05206 · doi:10.3389/fpsyg.2020.570895
Abstract
Causal processes can give rise to distinctive distributions in the linguistic variables that they affect. Consequently, a secure understanding of a variable's distribution can hold a key to understanding the forces that have causally shaped it. A storied distribution in linguistics has been Zipf's law, a kind of power law. In the wake of a major debate in the sciences around power-law hypotheses and the unreliability of earlier methods of evaluating them, here we re-evaluate the distributions claimed to characterize phoneme frequencies. We infer the fit of power laws and three alternative distributions to 166 Australian languages, using a maximum likelihood framework. We find evidence supporting earlier results, but also nuancing them and increasing our understanding of them. Most notably, phonemic inventories appear to have a Zipfian-like frequency structure among their most-frequent members (though perhaps also a lognormal structure) but a geometric (or exponential) structure among the least-frequent. We compare these new insights the kinds of causal processes that affect the evolution of phonemic inventories over time, and identify a potential account for why, despite there being an important role for phonetic substance in phonemic change, we could still expect inventories with highly diverse phonetic content to share similar distributions of phoneme frequencies. We conclude with priorities for future work in this promising program of research.
arXiv comment29pp (3 figures, 3 tables). This article has been provisionally accepted for publication (Frontiers in Psychology, Language Sciences). Supplementary information, data and code available at http://doi.org/10.5281/zenodo.3886212
References in corpus (9)
- Power-law distributions in empirical data
- Power laws, Pareto distributions and Zipf's law
- Beyond the Zipf-Mandelbrot law in quantitative linguistics
- Can power-law scaling and neuronal avalanches arise from stochastic dynamics?
- Stochastic phonological grammars and acceptability
- Gibrat's law for cities: uniformly most powerful unbiased test of the Pareto against the lognormal
- Phylogenetic signal in phonotactics
- Fitting heavy tailed distributions: the poweRlaw package
- How to read probability distributions as statements about process