5 papers
Information in probability: Another information-theoretic proof of a finite de Finetti theorem
Lampros Gavalakis, Ioannis Kontoyiannis
We recall some of the history of the information-theoretic approach to deriving core results in probability theory and indicate parts of the recent resurgence of interest in this a…
Entropy and the Discrete Central Limit Theorem
Lampros Gavalakis, Ioannis Kontoyiannis
A strengthened version of the central limit theorem for discrete random variables is established, relying only on information-theoretic tools and elementary arguments. It is shown…
An Information-Theoretic Proof of a Finite de Finetti Theorem
Lampros Gavalakis, Ioannis Kontoyiannis
A finite form of de Finetti's representation theorem is established using elementary information-theoretic tools: The distribution of the first random variables in an exchangea…
Sharp Second-Order Pointwise Asymptotics for Lossless Compression with Side Information
Lampros Gavalakis, Ioannis Kontoyiannis
The problem of determining the best achievable performance of arbitrary lossless compression algorithms is examined, when correlated side information is available at both the encod…
Fundamental Limits of Lossless Data Compression with Side Information
Lampros Gavalakis, Ioannis Kontoyiannis
The problem of lossless data compression with side information available to both the encoder and the decoder is considered. The finite-blocklength fundamental limits of the best ac…