5 papers
Lagrangians, Renormalization, and Quantization in Prefix Coding
Alexander Kolpakov, Aidan Rocke
We develop a statistical mechanics framework for prefix coding based on variational principles, renormalization, and quantization. A Lagrangian formulation of entropy-optimal encod…
Benford's Law from Turing Ensembles and Integer Partitions
Alexander Kolpakov, Aidan Rocke
We develop two complementary generative mechanisms that explain when and why Benford's first-digit law arises. First, a probabilistic Turing machine (PTM) ensemble induces a geomet…
Multiplicative Turing Ensembles, Pareto's Law, and Creativity
Alexander Kolpakov, Aidan Rocke
We study integer-valued multiplicative dynamics driven by i.i.d. prime multipliers and connect their macroscopic statistics to universal codelengths. We introduce the Multiplicativ…
The Information Geometry of UMAP
Alexander Kolpakov, Aidan Rocke
In this note we highlight some connections of UMAP to the basic principles of Information Geometry. Originally, UMAP was derived from Category Theory observations. However, we posi…
On the impossibility of discovering a formula for primes using AI
Alexander Kolpakov, Aidan Rocke
The present work explores the theoretical limits of Machine Learning (ML) within the framework of Kolmogorov's theory of Algorithmic Probability, which clarifies the notion of entr…