Compression and the origins of Zipf's law for word frequencies

Abstract

Here we sketch a new derivation of Zipf's law for word frequencies based on optimal coding. The structure of the derivation is reminiscent of Mandelbrot's random typing model but it has multiple advantages over random typing: (1) it starts from realistic cognitive pressures (2) it does not require fine tuning of parameters and (3) it sheds light on the origins of other statistical laws of language and thus can lead to a compact theory of linguistic laws. Our findings suggest that the recurrence of Zipf's law in human languages could originate from pressure for easy and fast communication.

arguments have been improved; in press in Complexity (Wiley)

References in corpus (2)

• Large-scale analysis of Zipf's law in English texts
• Compression and the origins of Zipf's law of abbreviation

Cited by in corpus (11)

• Power-law size distributions in geoscience revisited
• Linguistic laws in biology
• The origins of Zipf's meaning-frequency law
• Optimization models of natural communication
• Polysemy and brevity versus frequency in language
• The brevity law as a scaling law, and a possible origin of Zipf's law for word frequencies
• From Boltzmann to Zipf through Shannon and Jaynes
• Parallels of human language in the behavior of bottlenose dolphins
• On the class of coding optimality of human languages and the origins of Zipf's law
• Co-occurrence of the Benford-like and Zipf Laws Arising from the Texts Representing Human and Artificial Languages
• The advent and fall of a vocabulary learning bias from communicative efficiency